Python Web Scraper using Playwright needed (broken HTML, lazy loading)

@livegoodlife

chocolate Hello there, I am experienced in web scraping and building scripts or a Windows desktop application using Python. I am also experienced in large data scraping from a given website, bypassing IP, Captcha, and anti-bot or cloud flair protection. Please message me to discuss this project in detail. Best Regards

@a4logic

Hello, Chocolate, and thank you for taking the time to read my proposal. I understand how crucial it is to scrape data from broken HTML and handle lazy loading. My proficiency in JavaScript and understanding of complex 'div' structures will allow me to efficiently navigate and extract the necessary data for your project. Additionally, having experience with playwright and API handling, I can seamlessly integrate the scraping functions into your existing codebase to give you a stress-free experience. As a part of our web service provider company, I've worked on various large-scale projects that demanded intricate web scraping techniques. Crafting code to address Murphy's law scenarios has always been our forte; we're dedicated to providing robust, hassle-free solutions. Impressed with your conscious decision to prevent automatic proposals, I assure you that our team aligns with your work ethics – we don't believe in half-hearted efforts or spamming. I look forward to boost your productivity with accurate results through efficient web scraping with Playwright. Not only will I meet your current requirements but I'm also excited to learn more about additional tasks such as site login-logout and reloading data/state which we'll definitely discuss in detail. Let's transform your ideas into reality - together! Thanks!

@mananraja

Hey chocolate, Hi I have expertise in Web Scraping and will suggest you to ditch playwright/selenium and opt for a different approach relying on inspecting backend requests and then emulating them in your Python script. I'm available to discuss further details in chat and can start right away. Abdul H.

@ZohaibRoy

⭐⭐⭐⭐⭐ Scrape Complex Data from Websites Using Python and Playwright ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project requirements and see you're looking for someone to scrape data from a website using Python and Playwright. You don’t need to look any further; Zohaib is here to help! My team has successfully completed 50+ similar projects for data scraping. I will connect to the URL, navigate through the unstructured HTML, and efficiently extract the required data while keeping the browser open. ➡️ Why Me? I can easily handle your web scraping project as I have 5 years of experience in Python programming and web scraping. My expertise includes data extraction, handling lazy loading, and working with complex HTML structures. Additionally, I have a strong grip on Playwright and other web automation tools. ➡️ Let's have a quick chat to discuss your project in detail. I can provide samples of my previous work and show you how I can meet your needs. Looking forward to our conversation! ➡️ Skills & Experience: ✅ Python Programming ✅ Web Scraping ✅ Playwright Automation ✅ Data Extraction ✅ HTML Parsing ✅ API Integration ✅ Error Handling ✅ Script Debugging ✅ Data Analysis ✅ Handling Lazy Loading ✅ Browser Automation ✅ Function Implementation Waiting for your response! Best Regards, Zohaib

@mannanmaan1425

Hello Claus R., I have read the project details and understood the overall requirement. I am Abdul with 5 years of experience in JavaScript, Python, Data Processing, Web Scraping, Website Testing, Data Extraction, BeautifulSoup, Selenium Webdriver, Selenium, and Automation. I have successfully delivered multiple projects in the same domain. For this project, I plan to utilize Python and Playwright to scrape the required information from the website. I will navigate through the broken/unstructured HTML and handle lazy loading to extract the data efficiently. I will implement functions to interact with the site, perform searches based on specified date ranges, and manage the scraping process as per your instructions. You can view my portfolio here: https://www.freelancer.com/u/mannanmaan1425 Please ping me back so we can discuss the project further in the chat. Best regards, Abdul

@vano101

chocolate - I am putting this word instead 'Hello' per your request Hello, I am interested in this project and I have several years of experience with automated Web scraping and Python programming About "Broken/unstructured HTML" - I would like to reproduce it - I still think it may be structured indeed but "in unusual way" Seems that site requires login and logout, correct? Thanks

@onlinejob247

Hi, I am ready to start right now! Okay. I have huge experience in Python Web Scraper projects. If you need sample work just send me a message. Waiting for your quick reply.

@sagarwal3005

Hi there! I am interested in helping you scrape data from the website using Python and playwright. I have experience dealing with broken HTML and lazy loading. I can navigate the deep and unstructured 'divs' to find the required values. I can also handle searches and login/logout functions. Let's discuss the details and negotiate a fair price. I am ready to tackle the challenges and provide you with the data you need. Looking forward to working with you! Oh, and by the way, I love chocolate!

@divumanocha

Hello, I came across your project and found it truly interesting. With over eight years of hands-on experience in this field, I have successfully delivered high-quality solutions to clients worldwide. My dedication to excellence is reflected in the 180+ positive reviews from satisfied clients. I’d love to bring this expertise to your project and ensure outstanding results. However, I do have a few important points I’d like to clarify to align perfectly with your vision. Let’s connect via chat, where I can also share relevant examples of my past work. I'm looking forward to hearing back from you! Best Regards, Divu.

@seefattechnologi

'chocolate' ---->>I am highly qualified to do this job with high QUALITY Python Web Scraper using Playwright needed (broken HTML, lazy loading) ----- I am Passionate PYTHON /Full stack developer having rich experience with so many successful Tasks. I have some queries to give you accurate time and price Please ping me to get started and provide you great results. Thanks

@intelliresponse

Chocolate. As an industry expert with over 13 years of programming experience, I am confident in my abilities to tackle your complex Python web scraping project. With an impressive portfolio of work that includes sports data extraction, business license scraping, and even E-Visa form automation, I have honed my skills to tackle seemingly insurmountable tasks- much like your project awaits. My adeptness with comprehensive Python libraries such as Playwright, BeautifulSoup, and Scraping has given me the edge when dealing with unstructured HTML and lazy loading - which are the exact challenges you anticipate for this venture. As a cherry on top, I pride myself on being solution-driven. You can count on me to go beyond 'scraping' by helping you control the automated browser, handling data between different functions, and addressing anything else that's needed for your specific project. I would love to learn more about your site and the data you need so we can discuss timelines and pricing for the job. It's also worth mentioning that alongside scraping capabilities, I can provide insights into important future work regarding the site's data reloading patterns. Let's create a seamless operation together where you can trust me to handle the technical aspect while you focus on your core business needs. Please don't hesitate to reach out and grab a virtual cup of coffee (or chocolates!) for further discussion!

@anshumanvermaUK

Hi chocolate – I’m interested in your project and can handle scraping from sites with broken/unstructured HTML, lazy loading, and deep div structures using Playwright in Python. I can connect to the site, implement the search/date logic you describe, return data without closing the browser, and also provide Playwright login/logout handling for future tasks.

@Dtechonolgy

Hello, chocolate 1. I’m a freelancer experienced in Python web scraping, automation, and handling complex, unstructured websites using tools like Playwright, Selenium, and BeautifulSoup. I can handle deep nested divs, lazy loading, and dynamic content while keeping the browser session active as per your requirements. 2. A few quick questions to clarify the workflow: * Can you provide the date format you expect for the `do_search` function? * Are there any authentication methods (login via form, OAuth, etc.) we need to handle? * How frequently should the scraper check for new data updates? 3. I focus on creating reliable, maintainable scraping scripts with clear functions for data extraction, search execution, and session management, ensuring the browser stays active until you explicitly stop it. I can also provide guidance on login/logout automation using Playwright. Regards, Diligent Technologies

@denisSolution

Hello client, I’ve carefully reviewed your job description and have strong experience in these Selenium, Data Processing, JavaScript, Data Extraction, Automation, Python, Website Testing, Selenium Webdriver, Web Scraping and BeautifulSoup. I can build a reliable web scraping solution tailored specifically to your needs. Whether using Node.js with Puppeteer/Cheerio or Python with Selenium/BeautifulSoup, I will extract, clean, and organize your data efficiently. I also handle anti-bot protections, pagination, and full automation as required. As you can see from my profile, my web scraping reviews are excellent, reflecting my commitment to quality work. I focus on writing clean, maintainable, and scalable code because I know the difference between 99% and 100%. If you hire me, I’ll do my best until you’re completely satisfied with the result. Let’s discuss your target website and preferred data format. Thanks, Denis

@hassannaweed4

Chocolate! As an experienced software engineer, I'm well-versed in utilizing Python and Playwright for efficient and effective web scraping even with the most challenging conditions. With my strong command over Selenium, I’m no stranger to working with broken, unstructured HTML, or dealing with lazy loading. My proficiency in BeautifulSoup would come in handy when it comes to navigating the 'deep' or poorly marked HTML structure of your target site. Apart from scraping data, my proficiency extends to automation workflows and that includes login and logout features using playwright. Thus, I can easily help you in learning the approaches of automating these as well for a comprehensive solution to your requirements. Lastly, my clients frequently praise my results-oriented mindset - I never stop until the desired outcome is achieved. Given this site's dynamic nature (where reloading presents new data), I’m uniquely capable of adapting my scraping solution to handle this, ensuring fresh results every time. Let's connect to discuss further about the project scope and negotiate a budget that suits us both!

@Sohail748

Hi there, I can help you develop a Python-based web scraper using Playwright that can handle broken HTML structures, lazy-loaded content, and dynamic JavaScript rendering. I specialize in building scrapers that wait for elements to load, scroll or paginate automatically, and extract clean, structured data even from sites with irregular markup. I’ll implement intelligent selectors, error handling, retries, and data validation to ensure accuracy and reliability. I can also integrate headless browsing, custom headers, and proxy rotation to avoid detection, as well as export results to formats like CSV, Excel, or databases. Whether you need product data, listings, or other structured information, I’ll deliver a robust Playwright scraper that navigates complex pages, bypasses lazy loading, and outputs clean, ready-to-use datasets. Best regards, Sohail

@Muhammadzeesha59

I must say, your attention to detail and specific project requirements are refreshing! Having extensively worked with Python's Playwright library and specialized in web scraping, I can assure you that solving your unique challenge is right up my alley. As a skilled full-stack developer with over six impressive years in the industry, I've amassed invaluable knowledge in unstructured HTML scraping - Imagine turning the intricate 'divs' on your website into simply organized data! Furthermore, I have a deep understanding of lazy-loading techniques and how broken HTML can frustrate consumers of web data and make scraping complicated. Thus, using my proficiency in Playwright, I'll navigate through any obstacles on the platform you provide to deliver the precise data you need. I see that you also mentioned something about logging in and out using playwright - no problem at all! This is an integral part of web scraping that I often deal with and even take pride in automating these tasks. Lastly, I couldn't agree more on your stance about the automatic proposals being a tinge annoying. Let me be different. For your project, not only will I handle the initial task excellently but also update you on how to efficiently reload data to help optimize results. Trust me when I say that hiring me will bring 'ekstra' value to your project! So let's win this war against the tedious scraping approach by unleashing the functional, fast, and robust powerof my Python skills, together!

@topcreator100

Hi There Claus R., Good evening! I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Node JS, Ruby on Rails, html/css as well as javascript and jquery. I have rich experienced in Python, Selenium Webdriver, BeautifulSoup, Data Extraction, JavaScript, Selenium, Web Scraping, Automation, Website Testing and Data Processing. For more information about me, please refer to my portfolios. I’m ready to discuss your project and start immediately. 'chocolate' Looking forward to hearing you back and discussing all details.. Thanks and Regards

@makotok5

'Chocolate!' I'm delighted to be considered for your project. My extensive 7-year expertise aligns perfectly with the complex nature of your web scraping requirements using Python and Playwright. Being skilled in BeautifulSoup, JavaScript, Python, Selenium, Selenium Webdriver and Web Scraping, I am well-versed in navigating challenging HTML structures and ingenious at identifying elusive data points. My prior work on similar projects has honed my ability to forge precise search queries that extract relevant information without unnecessary fluff. I can assist you in structuring your Python functions -such as 'here_is_the_data_from_the_site(dict_or_something_like_that)' and 'do_search(from_date_string, to_date_string)'- which suit your needs while ensuring superior performance. Additionally, one of my core specializations is handling login/logout scenarios through web automation which directly aligns with your requirement. My commitment to delivering quality results on time along with clear communication makes me an ideal fit for your demanding needs. I am eager to learn more about your project so we can further discuss the details including the periodic data-reload specifics! And finally, congratulations for taking a stand against automatic proposals! Let’s create something amazing together!