
Closed
Posted
I need a rock-solid scraper that can pull both product text and all related images from a JavaScript-heavy e-commerce site. The pages rely on lazy loading and endless scrolling, so I’ve been leaning on Playwright to render each view while using Scrapy’s crawl engine to fan out across categories and pagination. The goal is straightforward: capture every SKU’s name, price, description, variants, and the full-resolution image set, then export the lot to a clean JSON (or CSV) plus a mirrored folder of images. Here’s how I picture the engagement: you build a Playwright-powered spider that logs in if required, waits for dynamic content, and hands the DOM to Scrapy for high-speed harvesting. The solution should respect [login to view URL] delays where possible and retry gracefully on captchas or throttling. I’ll run this on a headless Ubuntu box, so a [login to view URL] or Pipfile and a brief README are essential. Deliverables • Fully commented Playwright + Scrapy script(s) • Sample output file with 50–100 products demonstrating text and image links • Local image archive matching the sample output • README with setup, run command, and troubleshooting tips Acceptance criteria: the script must finish a full category crawl without manual intervention, save all images at original quality, and structure data exactly as outlined above. If you have prior experience bypassing dynamic loading on retail platforms, that’s a big plus—please mention it when you bid.
Project ID: 40746536
72 proposals
Remote project
Active 1 day ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
72 freelancers are bidding on average $20 USD/hour for this job

⭐⭐⭐⭐⭐ Rock-solid Playwright‑Scrapy scraper for JS heavy e‑commerce sites ❇️ Hi My Friend, I hope you are doing well. I checked all of your project requirements and I can see you are looking for a scraper that pulls product text and images from a JavaScript‑heavy site. You have no need to look any further as Zohaib is here to help you! My team is already doing 50+ similar projects for e‑commerce data extraction. I will build a Playwright‑powered spider that logs in, waits for lazy loads, and hands the DOM to Scrapy for fast crawling. I will also add a README, requirements file and a sample output folder at no extra cost. ➡️ Why Me? I can easily do your scraper as I have 5 years of experience in Python, Playwright, Scrapy, web automation, and data extraction. Not only this, I have a strong grip on HTTP handling, image downloading, and JSON/CSV generation. ➡️ Let's have a quick chat to discuss your project in detail and let me show you samples of my previous work. Looking forward to discussing with you in chat. ➡️ Skills & Experience: ✅ Python ✅ Playwright ✅ Scrapy ✅ Web Automation ✅ Lazy Loading ✅ Infinite Scroll ✅ Data Parsing ✅ Image Download ✅ JSON Export ✅ CSV Export ✅ API Integration ✅ Debugging Waiting for your response! Best Regards, Zohaib
$17 USD in 40 days
8.1
8.1

Hi, I can help you with "E-commerce Text and Image Scraper" as per your given project description. We can discuss more in detail during a chat conversation when you are available. I've worked on many PHP projects in recent times. So I am confident on achieving your expected Goals. Please initiate a communication thread to discuss further and start with the project. ⭐ 5.0/5 from a recent client: "Good work delievered thank you for your patience" Final timeline and cost will be confirmed in chat after a complete understanding and documentation of the project expectations in detail.
$15 USD in 1 day
7.5
7.5

★★★ TOP 1% IN FREE LANCER WORLD ★★★ ★★★ 20+ Year Experience in IBD being CMD★★★ ★★★ 200+ Country Satisfied Clientele ★★★ ★Linkedin★ ★Data Entry★ ★Business Plans★★★ ★★★ Operational Strategic planner Customer Support 24*7★★★ ★★★Excel/Word Operation★★★ ★★★Chat Support★★★ ★★★Calling Support★★★ ★★★Business Plans / Marketing Strategy ★★★ * Digital Marketing★★★ ★★★Social Media Marketing ★★★ ★★★Internet Marketing ★★★ ★★★Any type of Data Projects★★★ ★★★★★★ Regards, ★★★CMD★★★ ★★★PVSYS GROUP (INDIA)★★★ YOUR HONEST and DEDICATED WORKER ★★★IF YOU THINK THEN I CAN★★★
$15 USD in 40 days
7.8
7.8

I would be a perfect fit for your e-commerce text and image scraping project. With over 13 years in the industry, I've developed deep expertise in building customized python web automation and data mining solutions, just like the one you're looking for. My experience spans across a range of challenging projects, including automating complex websites with lazy loading and endless scrolling using Scrapy and Playwright, similar to what your project requires. Moreover, as someone who has worked extensively with full-stack technologies, mobile applications and Web3 development, I can ensure that the final output aligns perfectly with your expectations. I'm comfortable working with Ubuntu based headless systems, which would be perfect for running your scraper. Finally, my commitment to delivering high-quality work shines through my completed projects across various industries. Your satisfaction is my ultimate goal! So why wait? Let's get started on your project today!
$25 USD in 40 days
7.3
7.3

From what I've understood, you need a scraper for an e-commerce website that collects both product text and images and organizes the extracted information into a structured dataset. The goal is to reliably capture the required product details at scale while keeping the data clean and consistent. The key consideration will be handling product variations, pagination, image URLs/downloads, missing fields, duplicate products, and changes to the source site's structure. A few points I’d clarify: * Which product fields need to be collected, such as title, description, price, SKU, category, variants, or specifications? * Should images be downloaded locally or should the output contain their source URLs? * Does the scraper need to cover all products or only selected categories/search results? * How should product variants and multiple images per product be represented? * What output format do you need—CSV, Excel, JSON, database, or another system? * Should the scraper support scheduled runs and update only new or changed products? We can build the scraping workflow with structured extraction, image handling, pagination, duplicate prevention, validation, and error logging so the resulting dataset is ready to use. Please note: The budget and timeline in my bid are placeholders. Best Regards, Sagar Jain
$20 USD in 40 days
7.1
7.1

Hello, I'm Asma, Web Developer and Graphic Designer with 10 years of experience working with clients and agencies from around the world. Creative problem solver with a passion for creating visually appealing and user-friendly digital solutions. I love building luxurious brands and designing captivating visual identities. I've worked with clients in lifestyle, property, fashion, hospitality, and luxury sectors. 24/7 Support & Faster Response . #WEBSITE DESIGNING / DEVELOPMENT #WORDPRESS/HTML/JS/CSS/PHP/LARAVEL/SHOPIFY #GRAPHIC DESIGNING #UX/UI #FIGMA #SQUARESPACE #SOCIAL MEDIA MARKETING #PHOTOSHOP/ILLUSTRATOR #GOOGLE ADS #JEWELERY DESIGNER #LOGO DESIGN #BANNER DESIGN #BUSINESS CARD #STATIONARY DESIGN #CD COVER #POWERPOINT PRESENTATION #BOOK COVER #LETTERHEAD DESIGN #3D LOGO #WORDPRESS #WEBSITE PAGE SPEED UP UPTO 95-99 #WEBSITE SEO #FIGMA TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL #PSD TO WORDPRESS/HTML/JS/CSS/PHP/LARAVEL ...... ETC :)
$20 USD in 1 day
6.4
6.4

Hi, I can have this done for you very fast, check my profiles and reviews. And lets get in contact first.
$15 USD in 7 days
6.0
6.0

Hello I can develop an ecommerce text and image scraper to collect product names descriptions prices categories images SKUs and other required product information into a structured dataset With 20 years of software development experience I can work with Python Scrapy BeautifulSoup Selenium APIs image downloading data cleaning validation and automated scraping workflows A few quick questions Which ecommerce websites need to be scraped Which product fields and image formats are required Do you need the final data in CSV Excel JSON or directly imported into another ecommerce platform I’ll focus on accurate extraction image handling duplicate removal data validation and clean structured output while respecting applicable website access restrictions I’m available to start immediately Thanks
$16 USD in 40 days
6.0
6.0

Hi, I understand you need a robust scraper to extract product text and images from a JavaScript-heavy e-commerce site with lazy loading and endless scrolling. You're currently using Playwright to render views and Scrapy's crawl engine for category and pagination navigation. The main challenge here is efficiently handling the dynamic content loading and ensuring comprehensive data capture without overloading the server. I would first assess the site's structure and prioritize a strategy that balances thorough data extraction with server request efficiency, potentially implementing rate limiting and caching to maintain stability. With extensive experience in web scraping using Python, specifically with Playwright and Scrapy, I've tackled similar projects requiring dynamic content handling and large-scale data extraction. Q1 – Are there any specific categories or SKUs you want prioritized in the scraping process? Q2 – Do you need the scraper to handle potential changes in site structure automatically? Q3 – How frequently do you need the data refreshed or updated? Looking forward to hearing from you.
$15 USD in 7 days
6.0
6.0

Hello, I'm interested in your project and ready to start now. You can give me a chance to deliver you a magnificent projects with my best skills. Please send me a message so that we can discuss more. Regards, Piyash D.
$15 USD in 40 days
5.5
5.5

Endless scrolling and lazy loading eat scripts alive, so half the products never get scraped. You’ll have every SKU’s data and images captured in one go, with nothing missing from any dynamic section or hidden category. First I lock down the exact category or authentication steps you want to target. Then I build the Playwright plus Scrapy engine that waits for all content and grabs every detail, saving it as clean JSON or CSV with a mirrored image folder. You get a README so you can run it on your Ubuntu box without a hitch. I’ll revise the output until the export and folder structure match your outlined spec, no loose ends. Does the site need a login, or is guest access enough?
$15 USD in 40 days
4.9
4.9

Your lazy-load + endless-scroll setup is exactly why I'd hand the rendered DOM to Scrapy after Playwright waits. I've done this on retail platforms before. Can start Monday.
$20 USD in 40 days
5.0
5.0

I have built scrapers for JS-heavy product pages before, usually Scrapy paired with Playwright to render the page then pull text and image URLs into a clean structured output, CSV or JSON, whichever you need. I can start today and have a working version by Thursday. These numbers are based on the post as written, we will refine them after a quick scope chat. Want me to send a quick plan?
$25 USD in 3 days
4.7
4.7

The challenge you're facing is the need for a robust scraper that effectively extracts product text and images from a complex, JavaScript-heavy e-commerce site. Your goal is to automate this data extraction process while handling dynamic loading and ensuring compliance with robots.txt. To address this, I suggest employing a Playwright-powered spider integrated with Scrapy for efficient crawling and data extraction. This approach will allow for seamless navigation through lazy loading and dynamic content, ensuring you can capture every SKU's details accurately. The implementation plan includes the following steps: 1. Set up the Playwright environment to log in and handle dynamic content waits. 2. Develop a Scrapy spider that handles pagination and category navigation comprehensively. 3. Create scripts that ensure images are saved in original quality and data is structured as per your requirements. 4. Deliver a detailed README to assist with setup and troubleshooting. What specific e-commerce platform or website are you targeting for this scraping task? If this aligns with your expectations, let's discuss the next steps.
$25 USD in 3 days
4.5
4.5

Hello, I checked your project "E-commerce Text and Image Scraper" and already have a clear understanding of your requirements and how to deliver them efficiently. I have solid experience in PHP, JavaScript, Python, and I've successfully completed similar projects by delivering high-quality, scalable, and reliable solutions. Why choose me? * Strong expertise in PHP, JavaScript, Python * Clean, optimized, and scalable implementation * Fast communication and regular progress updates * Focused on delivering results, not just completing the task I'm ready to start immediately and would be happy to discuss the details. Best regards, Umer
$15 USD in 40 days
4.5
4.5

Hi I am developer of scrapers and browser automation (python+playwright or chrome extension) What siteb you need to scrape? How hard its protection (reCAPTCHA or hCaptcha)?
$21 USD in 40 days
4.3
4.3

Hi, I can build a robust Playwright + Scrapy scraper for your JavaScript-heavy e-commerce site. I’ll handle login/session management, lazy loading, infinite scrolling, variants, pricing, descriptions, SKU data, and original-resolution images, with retries and throttling controls. Scrapy will manage scalable crawling while Playwright handles browser-rendered content. I’ll export clean JSON/CSV and organize a mirrored image archive. You’ll receive commented code, 50–100 product sample output, requirements and a detailed Ubuntu README. I’ll also include logging, error handling and resume support for interrupted crawls. Thanks Amit
$15 USD in 40 days
4.0
4.0

Hello, We are BhartiyaCoders, a professional software development team helping startups, businesses, and entrepreneurs build modern, secure, and scalable digital solutions. We handle all types of development projects, including websites, web applications, mobile apps, Android/iOS applications, custom software, REST APIs, backend development, third-party API integrations, payment integrations, database solutions, admin panels, dashboards, automation, bug fixing, performance optimization, and existing project improvements. Whether you need a complete product from scratch, an MVP, new features, API integration, backend development, or improvements to an existing system, we can manage the complete process from planning and development to testing, deployment, and maintenance. We focus on quality, performance, security, scalability, clean development, responsive UI, and timely delivery, with clear communication throughout the project. Share your requirements and we’ll suggest the right approach for your project. Let’s build something reliable and successful together. Best Regards, BhartiyaCoders
$15 USD in 20 days
4.1
4.1

Hi, there. "PLAYWRIGHT + SCRAPY E-COMMERCE SCRAPER" — you need a crawler that can reliably capture every product’s text, variants and original-quality images from a JavaScript-heavy store. I’d use Playwright for rendering, login and lazy-loaded content, with Scrapy handling category discovery, crawling and retries. For endless scrolling, I’d make the extraction wait for the actual product/image elements rather than relying on fixed delays. I’d also normalize SKU data, remove duplicates, preserve full-resolution image URLs and download the images into a predictable folder structure matching the exported records. The scraper would be designed for unattended Ubuntu execution, with retry/backoff handling for temporary failures and clear logging so failed products can be identified and reprocessed. I’ll include the requested sample output, image archive, requirements file and README with setup and troubleshooting steps. Can you share the target e-commerce URL and confirm whether login is required? Looking forward to working with you.
$20 USD in 40 days
3.5
3.5

Hi I have experience developing this kind of web scraping system for JavaScript-heavy e-commerce platforms using Playwright and Scrapy. When I developed several similar scrapers, the most important thing was reliably capturing complete product data and original-quality images even when the content was loaded dynamically through lazy loading and endless scrolling. While developing these systems, I faced products whose content appeared only after JavaScript execution, images that loaded progressively while scrolling, and crawls that could become unstable because of throttling or temporary request failures. To solve them, I used Playwright to render the product pages and trigger the required dynamic loading before passing the resulting content into the Scrapy crawl flow. For image completeness, I handled the lazy-loaded image URLs directly and added controlled retries for temporary failures so the crawl could continue without manual intervention. As a result, the scraper was able to collect structured product information and complete image sets more reliably while keeping the crawling process efficient. With this experience, I can help you build the Playwright + Scrapy solution, including the JSON or CSV export, mirrored image archive, sample dataset, requirements file, and README. Looking forward to discussing with you about your vision. Best regards Michel
$18 USD in 40 days
2.7
2.7

Yamuna Nagar, India
Member since Oct 2, 2026
₹600-1500 INR
₹12500-37500 INR
₹750-1250 INR / hour
$30-250 USD
$10-30 USD
$30-250 USD
$10-30 USD
$30-250 USD
€250-750 EUR
$250-750 USD
$250-750 USD
₹1500-12500 INR
₹100-400 INR / hour
$30-250 USD
$750-1500 USD
$15-25 USD / hour
₹1500-12500 INR
₹600-1500 INR
$10-30 USD
₹100-400 INR / hour
₹600-1500 INR