I need a scraper written in Python 3.9 that uses Beautiful Soup. It must be in the form of a function that I can call with a category link as a parameter, like this: [login to view URL]
Below you will see a category page example. Each category will have many pages, so each page will need to be crawled and each product examined.
A directory will be created for each listing and from each listing there are three sections of concern:
1) The Header contains prices, options, and images. A directory will need to be created for the header and contain text file with the URL of the product, a price for each option, and full size copies of each picture for each option.
2) The Overview contains text and pictures provided by the seller. A directory will need to be created for the overview containing the text in a text file and full size copies of each picture. The header remains the same for each option so it only needs to be captured once per listing.
3) The Customer reviews. I am only concerned with reviews that have photos. A directory needs to be created for the reviews and in it a directory for each review containing photos. Each review directory needs the text in a text file and full size copies of each photo. Like the category page there will be multiple pages of reviews that must be crawled.
The directory structure will be placed in the same directory of the script.
The script must be separated into the following functions:
scrape_category(category_URL) - the main function that calls all others
scrape_listing(listing_URL) - the function to be called from scrape_category to scrape each listing
As stated above this project must be written in python 3.9 and use the latest version of Beautiful Soup as the primary tool.
Bu iş için 15 freelancer ortalamada $159 teklif veriyor
Hi Michael J. I read your project very carefully and as a result i knew it is relevant for me. I am very favorite with Python and beautiful soup.I am expert in Web search,Web Scraping,Market Research,Lead Generation a Daha Fazla
Hi I am a web scraper developer. I have rich experience about python. I can develop it. Regards -----------------------Geraldine---------------
Hi, I read the job description. I am interested in this work. I am an experienced web scrapper with more than 6 years of experience. Please contact me for further discussions. Warm regards, Ginu
Hello! I can provide you full support for this project. I have high experience with web technologies and I am pretty sure I can help you. Feel free to contact me!
Hello, I am data engineer who is an expert in web crawling. I have crawled more than 500 websites of different countries at ease. I have a knowledge of various tools used for crawling like Scrapy, BeautifulSoup, Seleni Daha Fazla