Project Description is too long for this post. Please read attached word doc for full description.
We would like to buy a block of 80 hours doing PostgreSQL queries over Oil & Gas data. We are hovering at around 200 million rows of data that feed multiple user interfaces. All of this data needs a ton of cleaning and curation.
The PostgreSQL stuff will not be hard to do. Lot of case when, concat, substrings… just moving data from poor formats to good formats. For example, we may get a VARCHAR that is 1/1/2017 and need to convert it to date. Two second change. But we have hundreds of these date fields. Sometimes in a table with 1MM rows, we will have one badly formatted date – 1&1/2017. Getting that one bad date fixed is not the goal. We have to work around it to get the other 999,999 into date format. We need that VARCHAR in date format. And sometimes, the dates come in as 1/2017. Or some come in as MM/YYYY and others (in same field) are in MM/DD/YYYY format. You get the picture!
The easy part will be PostgreSQL. The hard part? Oil & Gas data is not written in lay speak. It’s a very technical industry… tubing, casing, tvd, formations… little of it will make sense. Of course, if you know O&G, huge bonus, but it’s not necessary or expected for this project.
We will interpret all the O&G stuff (for you) and send you simple sentences on what each c_ and m_ field should look like. You will then build the queries for each table.
80 hours could just be the beginning. We are already working on a Phase II. We would like to build aggregation queries around all 200 million rows for “highlights” we can report on a webpage. This would entail running row counts/sums/etc. for a ton of fields and even some basic equations. We would update these queries every night and have a web page that reports all the “macro” changes to our data sets each day. This would be used to educate users on how vast and complex the data is behind the UIs.
Finally, if you know XPATH, that’s a huge bonus for this project. We can engage you beyond the 80+ hours of PostgreSQL work to running our Web Scraper to go get more data. More data? More PostgreSQL cleaning and curation work. XPATH is not mandatory though. We prefer someone who is super comfortable writing queries. You will need that comfort while you are working with the Oil & Gas terminology.
Hi There, This is Nico, I was invited by Stella to the project. Already took a look at the attached document and even I´m more proficient working with MySQL, at the end of the day, and based on what you wrote, it is Daha Fazla
Bu iş için 19 freelancer ortalamada $1328 teklif veriyor
Hi, An upscale infrastructure of 8000 Square feet accommodating a team of 150+ in Pune, India. Our flexible onsite and offshore model helped us in scaling our reach & serving global clientele. Relevant Skills and Expe Daha Fazla
Hi there, We have proven track record of delivering Java based web applications (DropWizard, Jersey, Struts, JSF/RichFaces) with different front end libraries (AngularJS/JQuery) and template engines. Relevant Skills a Daha Fazla
The project sounds quite interesting and a long one. The problem area is cleaning so many-many rows perfectly. Better to handle it using stored procedures and some sql jobs. for future have such jobs. Relevant Skills Daha Fazla
Hi there I understand that you need an expert in database, specially PostgreSQL. I finished a telecom audit project in postgres which needed about 100TB space containing all call detail record of everyday call. It nee Daha Fazla
I guarantee you a first class service with the quality and in the time it deserves by putting at your disposal all my knowledge and years of practice. Habilidades y experiencia relevante I have more than 6 years of ex Daha Fazla
Hi, I work with PostgreSQL on a daily basis, creating reports for the different areas of the company that I work for. I'll be glad to help you cleaning your data. Jonathan.- Relevant Skills a Daha Fazla
Hello, I would like to work in your project. I have two years of experience in portgresql with complex queries. For me it would be a real challenge to help them. you can write me i am allways here. Habilidades y exp Daha Fazla
Hi there, Hope you’re doing well. I’m interested in the job and would like to work on it over 80+ hours or more. I have around 10 years of SQL experiences and also have sound knowledge of Postgres SQL, as well as X Daha Fazla
Greetings. I just have a visual over your project's details and feel privileged to tell you that this correlates with my domain of expertise. Please message me as i will like to ask a few questions. Relevant Skills an Daha Fazla
Hi Can complete your project perfectly. Always Keep trust and High Quality Review me in my portfolio Thank you Relevant Skills and Experience Database Administration, PostgreSQL, XML Proposed Milestones $1250 USD - Daha Fazla
Hi, how are you today? I read the description of your request, I get the complexity of the task. Cleaning and Querying records from a database can be a demanding task based on how the dirty the data is. I have wo Daha Fazla
Hello Thank you for your posting job. I have checked your job in detail and am confident on your job. I have full experience in IOS/ANDROID app development and ever made a lots of mobile apps Relevant Skills and Exper Daha Fazla
I'd like participate the project. I have enough free time and good relevant experience to do this. My working hours are within 6AM-8PM UTC, so have normal intersection with USA business time. Relevant Skills and Exper Daha Fazla
I have worked as a SQL (relational) database consultant for over 25 years. Also, I have well over seven years using PostgreSQL and GIS data (the majority of my PostgreSQL experience includes using the PostGIS spatial e Daha Fazla
I have 13 years experience in development so complex large queries are not uncommon to me. I agree I have no knowledge in oil and gas domain, but if I get proper explanation of the tables I can work Relevant Skills an Daha Fazla