Before I describe the project I would just like to explain what [url removed, login to view] is. this website basically scraps data from different e-commerce websites on a real time basis, categorizes them according to their own category templates and displays them. Once a user clicks on the product, it takes them back to the website which originally holds the inventory. We need to create something similar but for different websites.
The project will have two parts.
Part 1 - Web Crawler & Database Mapping
Create a crawler which will extract data from these three websites and maintain a clean database. This crawler will not be crawling one-time, it will be a continuous process as we want to ensure that we have up-to-date inventory from all three websites.
We will define three different websites from where we will be scraping data initially. based on the sitemaps of these websites, you will do entire data mapping and come up with a sitemap for our website. By Data mapping I mean, you will create a master category template (based on the three websites) and then show which category from each website will be accommodated under which of our category. for e.g there are cameras available on two different websites, one lists them under the category cameras, while the other lists them under the category of photography so you will have to map that under one category. The deliverable for this part will be a document which will show a master category template and then it will show where each category from the three defined websites will go.
Part 3 - Website Development
Create an e-commerce website which shows data which we have scrapped. It will be an exact replica of [url removed, login to view] with slight differences as we will be making it for some other region. The functionalities will be exactly the same as iprice.my. The function of this website will not be to offer a checkout, however, it will redirect the user to the original website who holds this inventory.
Preferred Languages/Technologies fro the Project:
Web App: AngularJS
Web Scraping: NodeJS or Java
API: NodeJS or Java
Bu iş için 19 freelancer ortalamada $1494 teklif veriyor
Hello [login to view URL] freelancer ranking is top 5th and i am full stack developer. I am very interested in your project and I hope to work with you. I am ready to start work for your project. I have enough experiences with W Daha Fazla
Hi there, I have read Project Description & fully understood the requirements, I do not see any technically hurdles, as everything is explained very well but your budget is very low, so would you be flexible in it? Daha Fazla
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database Daha Fazla
Hello, Before you select a part time developer from here, take a look at fugacode.com. If you like what you see, contact us. That's all. "Why hire freelancers? when you can hire professional developers for the sa Daha Fazla
Hello! I'm web scraping expert. I use python language and scrapy framework. My scripts works on windows, mac or linux, but linux is preferably. I can schedule scripts on server if it is required. I have more 200 fin Daha Fazla
I want to discuss this project with you further, let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, i used to be online 14 hrs in a day on this website so probably Daha Fazla
Hello I saw your invite message. thanks And i saw your proposal. I hope to work with you. Please discuss about project. Thanks
Before I describe the project I would just like to explain what [login to view URL] is. this website basically scraps data from different e-commerce websites on a real time basis, categorizes them according to their own Daha Fazla
Hello Sir, I am an interactive web designer currently located in the heart of Sri Lanka -- with a burning passion for designing -- and building simple, accessible, and beautiful graphical interfaces for all kind of Daha Fazla
I have read the project description and the preferred technologies. I have a small team of professional developers and would like work on this project. As you can see in project by my reviews regarding the scrapping, w Daha Fazla
I have plenty of experience writing scrapers and web development for freelancer. I have a vast experience with many programming languages and good practices essential for big projects like these. I read and write Engli Daha Fazla
I did sme thing in my previous project use casperJs for scrawling ....................................................................................................................................................... Daha Fazla
Hello, Previously I have developed many software based scrapers to scrape different website like Amazon, Craiglist, Yelp etc. So I am having good experience in SCRAPING BUT do not have any experience in node js. Th Daha Fazla
Hi, Sunny here. Its nice to e-meet you ! I can take care of this project, as i have done something similar like this one before in my professional career. Overall, i can make your Application attractive in te Daha Fazla
This would be far easier to do in php. ha! for me at least, right!? So I see what you are saying you want, I just don't see how your getting' it on that budget. J.
My name is Mike and I’m from UK. I work with individual clients and also provide outsourcing services for a number of UK and USA based agencies. Your project description sounds interesting to me and I do have skills & Daha Fazla
Hello sir i have a great experience in Web programming, web designer and web scraping, ive scrapped more than 1 million records in some projects and i can asure you that i will do an excellent job and delivery it in t Daha Fazla
Hello, For Immediate basis, I can start right away!!! I have gone through your complete job description, attached image "Architecture [login to view URL]" and have expertise to develop Web Crawler & Database Mapping PLUS We Daha Fazla
Abdulla here, having alot of experiencr in web development and developing applications in php laravel, nodejs, angular and ionic. you may have a look at my portfolio at [login to view URL]