Project ( involves crawling, Parsing, Data mining of Classifieds, Cars (Insurance), Real Estate, Deals, Holiday packages, Shoppping w/ notifications )
$30-250 USD
Teslim sırasında ödenir
I am looking for programmer who can create a site scraper/spider/extractor software plus development of classified and shopping site similar to [url removed, login to view] This work will be done in phasewise as there needs to be discussion on complete project, you can even take part of the project also like only crwaling the data or cars mdule etc.
We need this to be automated or manual. There could be about 10.000 ads to be crawled a day and be integrated in our system or received by csv. Second-hand Ads contains images, texts, free text. Apart from crawled data , we need the website to have facility where both dealers and individuals can post their listings for sale. Dealers can create profiles with static URL and build up their online showroom. Buyers can easily find and search basic and advanced listngs, compare the products and add to wish list, Recent searches,Cross Sale and Up sale. Contact car owners through the website. More details will be provided for bidders who can prove their ability to deliver.
I want to have option of people search for what they want. There will be paid adds also, I should be able to stop paid adds at anytime and also put them on hold.
There will also be a area where people can sign up to add their free or paid listing. Paid advertisers listings comes up before the free listings.
Primary objective for us is to extract and filter data from different sites related to classified ads for cars, real estate, shopping etc. Depending on the data to be extracted, each type of content will have it’s own fields to be extracted.
For example Cars:
I need all possible information, stored:
- product title
- make
- model
- condition(used or new)
- year
- miles
- color
- doors
- city
- Final URL(after redirection) of the classified ad
- Picture from Final URL(get representative car picture)
- description
- price
Minimum information required is:
- product title
- description
- price
- miles
- Final URL
- Picture taken from Final URL
This is important to decode final classified ad URL (where classified ad is located), get a URL car picture from final URL (where classified ad is located), and crawl only new items. The script must be able to crawl the whole site, check new items and store only new items.
Some of the sites to crawl data :
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
[url removed, login to view]
I would also like Facebook interaction, Twitter etc etc.
I would also like the site highly SEO to make it easy to find on Goggle
I would also like an easy payment option for my customers to pay for their ads ( Maybe also telephone payment as DoneDeal offers )
I would like Car Registration info finder for Car ads ( As Gumtree offers )
I would like an easy email system set up for when an ad is expiring that the customer will be reminded to renew their ad or bump it up ( Upselling )
Kindly submit your portfolio and brief me on your understanding of the project then i would proceed for communication. Kindly submit a Technical proposal of your understanding of the project with quote and timeline
Proje NO: #3990822
