I have a database in MySQL. I need a PHP script that crawls this website [login to view URL] (which is a craislist-type website) and fill my database with all the posts from revolico.com. I will provide the list of categories and the .sql file of the database. The script has to be called every day, so the same post cannot be inserted twice in my database.
Eventually I will start crawling other similar websites as well, so if one person posted the same in two websites, I do not want to have it repeated in my database. This means the way to avoid duplicates cannot be the time inserted, the script has to detect if the post (or a very similar one) is already on the database.
Also, if the job is finished on time and running good I will re-hire the freelancer to do the other crawlers. This one is the simplest one and should not take longer than few days. Also, if you want to use another language we can discus it, as soon as it runs in a Linux box environment. Understating Spanish is a great plus, since the website to crawl is in Spanish.
I've been writing several web scrapers for freelancer mostly in PHP and Python, I have a vast experience in several programming languages and good programming practices, so I can deliver good code. I read and write English fluently, and if necessary for this project I can understand Spanish as my native language is the close Portuguese. For this kind of project I would usually propose around $100 but you already set the $250 minimum, will be glad to discuss this project with you.
$250 USD 3 gün içinde
5,0 (18 değerlendirme)
4,0
4,0
11 freelancers are bidding on average $360 USD for this job
Hi,
I am PHP Web Expert and can write crawler for you according to your instructions. I have built few already. Please discuss to get started.
Thanks,
Shahzab