I am in the process of analyzing some publicly available data for quality. I need help with setting up and automating the pipeline to load and transform the data. Here are the steps as I see them, open for further discussion or suggestions:
1) Set up scripts to download the JSON files every month from a list of URLs, or whenever new data is available.
2) Once all files are downloaded, load them into MongoDB
3) Stitch the collections together for the purpose of analysis
Hoping for a turnover in a couple of weeks.
19 freelancers are bidding on average $191 for this job
Hi, Deer. I can help you with my skills and experiences. Regards. Relevant Skills and Experience node.js, mongodb Proposed Milestones $277 USD - default