Kapalı

Data Import Scripts in PHP (or Node.js or other...), MySQL etc.

I'll provide more info on successful shortlisting of Freelancers (see criteria below) but essentially what I need you to do is:

1. Create a new Database using the Data Schema I will provide (2 tables - products table with 42 columns/data points, deals table with 63 columns/data points approximately) on my server. The tables are linked by the Product ID field (relationship).

2. Create scripts (PHP or otherwise) that can do the following, in this order:

- Download a compressed file from the Retailers / URLs I provide (there are approximately 15-16 Retailers with each one having its own URL)

- Unzip the file which will contain a large CSV file (one file could have around 1 million rows of data).

- Extract the data in the CSV file and import it into the Database you created in the first action, separating Products and Deals from the CSV using the following rules:

1. For the Products import, the script must check first if the Product ID exists already, if so, the import must skip importing that particular product.

2. For the Deals import, it must first clear the existing deals in the Database from that URL / Retailer which can be done by using the retailer ID.

- Sends an email to me with a volume of the products and the deals imported or an email with the error if the import fails.

More requirements:

- There must be a script per URL so I have control of which scripts I run (if I want to just import the data from one URL manually I can do)

- A Cron job will need to be created so I can configure when the scripts run automatically on my server each day

- I need a very simple front end HTML page that requires a login to access with a summary of the imports (I will provide flat HTML files for you to use, you'll just need to integrate it with your scripts) and the ability to trigger the scripts.

- The server I have will have (at best) 2GB RAM and 2 processors. The scripts need to run optimally and complete quickly (I will allow a maximum of 1 hour for the largest script / import to run), I cannot approve this project as complete unless this happens so please think about how you plan to build this with the potential size of the CSV files..

- Each CSV file will be structured in exactly the same way, so the scripts only need to be created once as they can be applied to all the CSV files that will be downloaded from each Retailer / URL

- There are other options when it comes to the files to be downloaded, if you think this would be better

File format and compression options available of the files to be downloaded:

- XML (no DTD)

- XML (DTD 1.5)

- XML (DTD 1.4)

- CSV

Compression:

- ZIP

- GZIP

Process:

- Ill review all submissions and bids

- Ill report and block automated bids or those that havent read the description above.

- Ill shortlist the freelancers that I think can do the work based on their bid and what they write in their proposal. Unrealistic prices will also be removed.

- Shortlisted Freelancers will get a message with the Data Schema attached and an example of one of the CSVs with an opportunity to ask any questions.

- Ill choose a Freelancer to work on the project and create a new project for them specifically.

Beceriler: Data Extraction, Veri İşleme, MySQL, node.js, PHP

Daha fazlasını gör: html php node.js, excel data import php mysql, import scripts xml php mysql, node mysql tutorial, nodejs mysql connection pool, node js mysql login example, node.js express mysql example, npm install mysql, node mysql promise, node js mysql insert example, npm mysql2, php, mysql, data processing, node.js, web data extraction scripts php, scripts php mysql previous, scripts php mysql checkbox, auto data txt insert php mysql, scripts php edit field mysql

İşveren Hakkında:
( 53 değerlendirme ) Barnsley, United Kingdom

Proje NO: #16023590

Bu iş için 11 freelancer ortalamada £218 teklif veriyor

codetastic

This bid is to write code in Python to import a CSV file into a MySQL database. The script will incorporate an email notifier on sales volume or import error. It will skip existing ids for products and clear / update Daha Fazla

in %bids___i_period_sub_35% gün içinde250%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(42 Değerlendirme)
6.1
superman1987417

Greetings. Thank you for your job posting. I'm a php expert with excellent problem solving skill. I've studied your requirements and feel quite confident. I can make your script perfectly and quickly. I request yo Daha Fazla

in %bids___i_period_sub_35% gün içinde150%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(38 Değerlendirme)
5.9
waqas193

Hello, I have read your project requirements and exuberant to work on it. I have extensive 9 years Experience in this kind of projects & I will do the best in class. IT solutions Expertise include .Net, Graphic d Daha Fazla

in %bids___i_period_sub_35% gün içinde277%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(14 Değerlendirme)
5.4
shafayat1039

Hi I am Shafayat, I am an M.E.A.N. stack developer. I believe I am the perfect fit for this job. Let’s talk for a minute, you won’t regret it, I promise. Cheers

in %bids___i_period_sub_35% gün içinde222%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(10 Değerlendirme)
5.0
kazimking

Hello Sir, hope you are fine, I am interested in your work "to make a Data Import Scripts in PHP ". I am waiting for "Data Schema attached" in chat. I have 5 year experience in Web Development Service I am ab Daha Fazla

in %bids___i_period_sub_35% gün içinde200%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(33 Değerlendirme)
4.9
usmanhassan123

I am software engineer and expert in such tasks.

1 gün içinde %bids___i_sum_sub_32%%project_currencyDetails_sign_sub_33% GBP
(7 Değerlendirme)
4.6
Hussnain0163

Hello sir! I am ready to start right now. I have 5 years experience of Database development, bootstrap/ php / codeignitor / Laravel /cakephp / wordpress / opencart / Javascrip/JQuery / mobile app development. I can d Daha Fazla

in %bids___i_period_sub_35% gün içinde100%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(9 Değerlendirme)
3.4
jomingeorge94

Hi, I am web developer experienced in designing and developing websites for my own projects as well as for clients. I have just graduated from Newcastle University studying Bsc Computer Science. I have seen your pos Daha Fazla

in %bids___i_period_sub_35% gün içinde222%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(8 Değerlendirme)
3.3
in %bids___i_period_sub_35% gün içinde150%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(9 Değerlendirme)
3.0
ahtabbasi

HI there, I have read all the details. I understand that optimization of the code is very important to you. Although I haven't seen the sample input yet but I am sure I can deliver the quality required by you. Ho Daha Fazla

in %bids___i_period_sub_35% gün içinde400%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(2 Değerlendirme)
3.1
in %bids___i_period_sub_35% gün içinde172%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(8 Değerlendirme)
3.3