
Closed
Posted
Paid on delivery
I need a custom scraper for an e-commerce site to extract text and images. Requirements: - Scrape product details, descriptions, and images. - Handle dynamic content and pagination. - Deliver data in a structured format (CSV, JSON). Ideal Skills and Experience: - Proficiency in Python or similar languages. - Experience with web scraping tools (BeautifulSoup, Scrapy). - Knowledge of anti-scraping measures and how to bypass them. - Prior experience with e-commerce sites is a plus. Please include your relevant experience in your application.
Project ID: 40663681
61 proposals
Remote project
Active 3 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
61 freelancers are bidding on average ₹318,729 INR for this job

Youssef, Full-Time Python Developer specializing in e-commerce data extraction. You need a custom scraper to pull product details, descriptions, and images from your target e-commerce site. I'll use Scrapy for its robust handling of pagination and dynamic content, ensuring reliable data collection. BeautifulSoup can assist with precise parsing of text elements. I'll implement standard practices to manage anti-scraping measures, delivering clean, structured data in your preferred CSV or JSON format. I've completed multiple similar e-commerce scraping projects before. What is the specific e-commerce site URL so I can assess the exact structure? Ready to start immediately.
₹250,000 INR in 1 day
7.4
7.4

Hi there yeah I'm expert in python and I've read the project description and I'm sure that I can build a customer scrapper for sure Kindly send me a message we'll discuss further Really looking forward to hearing from you Thank you
₹250,000 INR in 3 days
5.9
5.9

Hi, I can build a custom e-commerce scraper that pulls product text, descriptions, and images into clean CSV/JSON output. I’ve worked on data extraction jobs involving dynamic pages, pagination, and bot-protected storefronts, so I understand the practical issues that usually come up in real scraping projects. The focus will be on stable extraction, organized output, and making sure the scraper is reliable enough for repeated use. If you want, I can also explain the best approach once you share the target site.
₹250,000 INR in 7 days
5.3
5.3

Your scraper will fail if the site uses Cloudflare or rate-limiting without proxy rotation and request throttling. Most e-commerce platforms also render product data client-side via JavaScript, so a static scraper won't capture the full catalog. Quick questions - what's the target site's anti-bot protection level (Cloudflare, Akamai, or basic)? And what's your expected data volume per day? Here is the architectural approach: - PYTHON + SCRAPY: Build a distributed scraper with rotating proxies, user-agent spoofing, and exponential backoff to avoid IP bans. - DATA EXTRACTION: Use Playwright for JavaScript-heavy pages and XPath selectors for structured parsing of product titles, prices, descriptions, and image URLs. - DATA PROCESSING: Export to JSON with nested product variants and CSV for flat analytics, including automated deduplication and schema validation. I've built scrapers for 6 e-commerce clients that process 50K+ products daily without detection. Let's schedule a quick call to review the target site's structure before we architect the solution.
₹337,500 INR in 30 days
5.6
5.6

Hi, We have worked on comprehensive E-Commerce Platforms, including one handling 1M+ Products, and another with supplier CSV imports and API syncing. For your scraper, I can handle product details, descriptions, images, pagination, and dynamic content, then provide clean CSV or JSON data. We are a team of professionals working in this sector for the past 12 years and I assure you that we will provide you with High Quality work with 100% satisfaction. Do you already have the target website URL? Best Regards, Harish
₹400,000 INR in 30 days
6.6
6.6

As requested, I am introducing myself as RAJAOUL HAQUE, a diligent and proficient freelancer with extensive experience in data mining, processing, and python programming. I have in-depth knowledge of data scraping tools like BeautifulSoup and Scrapy which are perfectly suited for the job. In addition to that, my familiarity with Python will ensure your e-commerce scraper is custom-built to cater to your specific needs. Working in data analysis has sharpened my proficiency in dealing with anti-scraping measures and their successful bypassing. This unique perspective enables me to find solutions and overcome any hurdles we may come across during the project - something crucial while extracting data from dynamic content and pagination on e-commerce sites. Lastly, having a background in creating clear visual content, reports, and presentations to explain complex data insights provides me an edge on delivering structured datasets. Striving for client satisfaction by delivering high-quality work within stipulated deadlines has always been my priority. So let’s join hands and turn your project into a successful result!
₹250,000 INR in 7 days
5.1
5.1

Hi, This fits me perfectly, and I'll get it done! Your project immediately caught my attention — this is exactly the kind of work I enjoy and excel at. I've built up solid experience in this area and I'm genuinely excited about the opportunity to contribute. I'd invite you to browse my profile and past work to get a sense of what I bring to the table. I'm available to start promptly and happy to jump on a quick call to align on your expectations. Let's make this happen!
₹450,000 INR in 45 days
3.9
3.9

Most e-commerce scrapes break not on the HTML but on the image pipeline, lazy-loaded srcsets and CDN tokens that expire before you finish downloading them. I'll build the scraper in Scrapy with Playwright fallback for dynamic pages, output products, descriptions and image URLs (plus local copies) as both CSV and JSON, and add retry and rotation logic to survive rate limits. One catch worth flagging: variant SKUs often share a parent URL, so the schema needs a parent-child structure or you'll lose colour and size data. 1) Which site is the target, and does it sit behind Cloudflare or similar? 2) Do you want images downloaded and stored, or just the URLs in the file? Ready when you are. Thanks Shayan
₹337,500 INR in 20 days
3.4
3.4

Hello, I can develop a reliable Python scraper to extract product details, descriptions, pricing, variants, categories, and product images from your e-commerce website. I’ll use Scrapy, Beautiful Soup, or Playwright depending on how the site loads its content. The scraper will support dynamic pages, pagination, retries, duplicate prevention, rate limiting, and structured CSV/JSON exports. Images can be downloaded into organized folders with their product references preserved. Estimated timeline: 3–7 days, depending on the website size and protection level. Before starting, could you confirm: ☑️What is the target website URL? ☑️Which exact product fields are required? ☑️How many products or categories need to be scraped? ☑️Should images be downloaded or provided as URLs? ☑️Is login, location selection, or CAPTCHA involved? ☑️Is this a one-time extraction or a reusable scheduled scraper? ☑️Do you have permission to collect and use the website’s data? I have experience building Python-based e-commerce data pipelines using Scrapy, Beautiful Soup, Selenium, and Playwright, including JavaScript-rendered pages, pagination, validation, and CSV/JSON output. I’ll use compliant access methods and won’t bypass authentication, CAPTCHAs, or access controls without explicit authorization.
₹375,000 INR in 15 days
2.8
2.8

Hi, Thanks for sharing your project. It aligns well with work I’ve successfully completed for other clients, and I’m confident I can deliver a high-quality solution tailored to your requirements. Before providing an accurate timeline, scope, and budget, I’d like to clarify a few key details to ensure we're aligned from the start. Freelancer’s proposal character limit makes it difficult to cover everything thoroughly here. If you're available, let's connect via chat. I can walk you through similar projects I've completed, discuss the best approach for your specific requirements, and answer any questions you may have. Once I understand your expectations, I'll provide a clear execution plan with realistic timelines and pricing. I’m ready to get started as soon as we finalize the details and look forward to working with you. Best regards, Mayank Sahu
₹375,000 INR in 7 days
2.9
2.9

Hello, I'm Asma, Web Developer and Graphic Designer with 10 years of experience working with clients and agencies from around the world. Creative problem solver with a passion for creating visually appealing and user-friendly digital solutions. I love building luxurious brands and designing captivating visual identities. I've worked with clients in lifestyle, property, fashion, hospitality, and luxury sectors. 24/7 Support & Faster Response . #WEBSITE DESIGNING / DEVELOPMENT #WORDPRESS/HTML/JS/CSS/PHP/LARAVEL/SHOPIFY #GRAPHIC DESIGNING #UX/UI #FIGMA #SQUARESPACE #SOCIAL MEDIA MARKETING #PHOTOSHOP/ILLUSTRATOR #GOOGLE ADS #JEWELERY DESIGNER #LOGO DESIGN #BANNER DESIGN #BUSINESS CARD #STATIONARY DESIGN #CD COVER #POWERPOINT PRESENTATION #BOOK COVER #LETTERHEAD DESIGN #3D LOGO #WORDPRESS #WEBSITE PAGE SPEED UP UPTO 95-99 #WEBSITE SEO #FIGMA TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL #PSD TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL ...... ETC :)
₹375,000 INR in 3 days
2.5
2.5

Hello, I am new to web scraping and eager to learn. While I do not have prior experience with Scrapy or similar tools, I am a dedicated learner and willing to put in the effort to understand your requirements and complete the project with guidance if needed.
₹250,000 INR in 30 days
0.0
0.0

Here! I’m a Full Stack Web Developer (Backend & Frontend) with over 6 years of experience and more than 600 completed projects, focused on building modern, high-performance, secure, and visually impressive websites and web applications. I can handle the complete development process from start to finish, including: • Professional and fully responsive frontend development • Modern UI implementation for desktop, tablet, and mobile • Backend development and business logic • Database design and integration • User authentication, login and registration systems • Admin dashboards and user management • REST API development and integration • E-commerce and payment integrations • Booking and reservation systems • Performance optimization and clean architecture • Testing, security, and deployment My technology stack includes:HTML5, CSS3, Bootstrap, Flexbox, JavaScript, React, C#, ASP.NET Core, REST APIs and Microsoft SQL Server. I don’t just build something that works my goal is to create a website or web application that looks professional, feels fast, works flawlessly across devices, and is structured to be secure, scalable, and easy to maintain. Whether you need a business website, e-commerce platform, web application, admin dashboard, booking system, API-driven platform, or a completely custom solution, I can develop it according to your exact professional requirements and price affordable. I’m waiting for your answer Kind regards, Jure
₹275,000 INR in 5 days
0.0
0.0

Hi, As a Senior Python/Backend Developer with 15+ years of experience, I specialize in creating robust web scrapers tailored to e-commerce platforms. I will ensure seamless extraction of product details, enhancing your data acquisition process. Execution Strategy: - Utilize Python with BeautifulSoup/Scrapy to build a resilient scraper. - Implement mechanisms to handle dynamic content and pagination effectively. - Design the scraper to bypass common anti-scraping measures for reliable data access. Key Deliverables: - Extracted product details, descriptions, and images in a structured format (CSV/JSON). - Comprehensive documentation for scraper usage and maintenance. - Clean, well-commented code for future enhancements. Quality & Performance: - Maintain high data integrity with efficient error handling. - Optimize for speed and reliability, ensuring timely data retrieval. Timeline & Next Steps: - Estimated delivery within 2 weeks, with regular updates throughout the process. - Available for ongoing support and adjustments post-delivery. Best Regards, Karthik B Resonite Tech
₹575,000 INR in 7 days
0.0
0.0

Hi — I build these regularly, so I'll be straight with you about the part that decides the price. Everything in your brief except one line is routine: Scrapy for the crawl, dynamic content and pagination handled by rendering only the pages that actually need it, products and descriptions to JSON or CSV, images downloaded with checksums so re-runs skip what hasn't changed. The line that matters is anti-scraping. Whether the target sits behind Cloudflare, DataDome, PerimeterX or nothing at all changes the build completely — a plain site is a couple of days, an aggressively protected one needs residential proxy rotation, TLS fingerprint matching and per-site tuning, and that gap is exactly why the bids on this project vary so widely. I would rather quote you honestly against the real target than underbid and renegotiate later. So: which domain, and roughly how many products? Once I know, I'll run a quick probe and tell you which tier it falls into before you commit anything. If it turns out to be the simple case, I'll say so and the price comes down. Also worth deciding early: one-off migration pull, or a scheduled tool you re-run? The reusable version wants monitoring and layout-change alerts built in, because e-commerce sites change their markup and a silent scraper failure is worse than a loud one. Stack: Python, Scrapy, Playwright, BeautifulSoup. Aakaash
₹250,000 INR in 5 days
0.0
0.0

Hi, We can develop a custom eCommerce scraper that collects the required product data reliably and stores it in a structured format. Our Python team can handle scraping, data processing, scheduling, and API integration. Two important questions: 1. Which eCommerce websites need to be scraped, and do they have any anti-bot or login restrictions? 2. Which product fields do you need, such as title, price, SKU, images, stock, variants, ratings, or specifications? Technical approach: • Build the scraper using Python, Scrapy, Selenium, or Playwright based on the target websites. • Create separate scraping logic for different website structures. • Extract, clean, validate, and normalize product data. • Handle pagination, dynamic content, variants, missing data, and duplicate products. • Add retry, timeout, logging, and error handling for reliable execution. • Store data in PostgreSQL, MySQL, MongoDB, or required format. • Add scheduled scraping and incremental updates where required. • Provide APIs or CSV/Excel/JSON export for the collected data. • Optimize requests and implement responsible rate limiting. • Test the scraper against real product pages and provide deployment support. We have Python, Backend, Data Engineering, QA, and DevOps resources available for complete project support. Best Regards, Nikhilesh Team Qloron
₹375,000 INR in 45 days
0.0
0.0

Mumbai, India
Payment method verified
Member since Mar 11, 2025
₹12500-37500 INR
₹600-1500 INR
€30-250 EUR
$250-750 USD
$30-250 USD
$15-25 USD / hour
$30-250 USD
£250-750 GBP
$30-250 USD
$14-30 NZD
$15-25 USD / hour
₹12500-37500 INR
₹1000-3000 INR
$30-250 USD
₹12500-37500 INR
₹1250-2500 INR / hour
₹75000-150000 INR
$25-50 USD / hour
₹1500-12500 INR
$15-25 USD / hour
$750-1500 USD