We have a large table with 2 ID columns. (2 billion rows). I need a script to run and compare the 2 columns and group by to create a results table that would include:
ID1, ID2, COUNT.
The end results table could be 15 billion rows.
I need this urgent
Mysql and other DBs are not fast enough and we need some sort of search technology like SOLR to generate the results table very very fast.
14 freelancers are bidding on average $520 for this job
If you don't mind to explore alternatives like ETL Tools (e.g. Pentaho Kettle) which could process billions or even trillions of records, please let me know.
Hi, We at on2itonline would love to work with you on this. We have read carefully the project description and fully understand the project requirement. Let's discuss further issues of the project through PM
This sounds really interesting to me. I really would like to do this job. I have 6 years experience working as software delevoper. I worked for companies like DHL, Amazon and IKEA.