Senior Software Engineer (Scraping / Web Automation)

@AwaisChaudhry

Hi there, I understand you need a senior engineer to design, build, and run high-volume web scraping and automation for real-time event access, with secure multi-account logins, proxy rotation, and a lightweight UI. I’ll map the current data pipelines, design a fault-tolerant scraping architecture using Playwright/Puppeteer, and implement robust session management, proxy rotation, and fingerprinting to handle anti-bot defenses. Expect efficient Windows background services for periodic sync, Azure Function orchestration, and a Blazor WebAssembly frontend to display event codes. I’ll prioritize clean architecture, strong testing, observability, and CI/CD improvements to keep deployments reliable in a time-critical environment. Which ticketing platforms are in scope and what anti-scraping measures (rate limits, CAPTCHAs, login quirks) should I plan for? What proxy rotation and fingerprinting approach do you prefer (rotation cadence, geo distribution, user-agent strategy), and any constraints? What are the data freshness targets and SLAs for real-time event codes, and how should monitoring and alerts be set up? What CI/CD flow and deployment targets do you expect for Azure Functions, Windows services, and Blazor apps (branching, tests, rollback)? Best regards,

@MashoodurRehman1

I am a senior software engineer with over 8 years of experience in web scraping and automation, proficient in using tools like Playwright, Puppeteer, and Selenium. My background in building distributed and fault-tolerant scraping systems aligns well with the needs of your data aggregation project. Additionally, I have practical knowledge of HTTP traffic, session handling, and browser automation internals, ensuring reliable and secure data retrieval. My experience with Azure and CI/CD pipelines supports building efficient and scalable architectures for real-time event management. I have successfully deployed solutions that incorporate proxy management and anti-detection strategies to maintain high-volume data collection across diverse platforms. Collaborating closely with technical stakeholders, I have designed robust systems that adhere to platform security and compliance standards while delivering on project requirements. I am interested in discussing how my skills align with your team's goals and the project's challenges. Could we schedule a time to explore this further? Thank you for considering my expertise for this opportunity.

@hirujiyu

➰➰ SENIOR SOFTWARE ENGINEER | WEB SCRAPING & AUTOMATION (8+ YEARS) Hi there, ✋As a senior engineer with deep expertise in web scraping, browser automation, and large-scale data retrieval to work closely with your client on a business-critical, time-sensitive system. I have extensive hands-on experience building robust, fault-tolerant automation systems using Playwright / Puppeteer, handling secure logins, proxy rotation, and anti-detection strategies in production environments. ♾️ To communicate in-depth, feel free to reach out to me. ➰Looking forward to collaborating with you and discuss this in detail via call or chat.! Thank you.

@irsolutions

As a seasoned Senior Software Engineer with extensive experience in web scraping and automation, I understand the critical need for robust, high-performance solutions in your project. Your requirement for automated data aggregation from third-party ticketing platforms perfectly aligns with my expertise in building scraping and automation modules for seamless data retrieval. I have successfully delivered similar projects in the past, optimizing performance and data consistency while ensuring system stability and resilience. My proficiency in web scraping tools like Playwright and Puppeteer, coupled with experience in backend languages such as Python and JavaScript, makes me well-equipped to tackle the challenges of your multi-component solution. Beyond technical skills, I emphasize collaboration, innovation, and customer-focused mindset in all my projects. I am ready to work closely with your team and the client to define priorities, make architectural decisions, and drive continuous improvements in the system. If you are looking for a proactive and reliable Senior Software Engineer to enhance your web automation project, I am here to help. Let's connect to discuss how we can achieve success together.

@tangramua

Dear David W.,   We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time.   We are 25 years in this business and our technical specialists have strong experience in JavaScript, Python, Django, Node.js, Express JS, Redis, Typescript, GraphQL, FastAPI, REST API and other technologies relevant to your project.   Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews.   Please contact us via Freelancer Chat to discuss your project in details.    Best regards, Sales department Tangram Canada Inc.     

@Guptapuru304

We have successfully executed similar projects and are confident in our ability to meet your needs for this senior software engineering role. Our expertise in web scraping and automation, combined with our track record, makes us an ideal fit. We understand the need for robust, high-volume data retrieval and are well-versed in using Playwright and Puppeteer for browser automation, ensuring reliability with advanced proxy rotation techniques. With over 8 years of experience and a diverse skill set in JavaScript, Python, FastAPI, and more, we excel in designing scalable, fault-tolerant systems. Our AI-first thinking aligns perfectly with the integration of Azure Function Apps and Blazor WebAssembly, facilitating real-time data aggregation and seamless user interaction. Our portfolio showcases our proficiency in delivering impactful, intelligent solutions that exceed expectations. Let’s discuss how we can drive technical excellence and innovation in your project. Q: Could you share any specific challenges you've faced with the current system? Q: How frequently do you expect updates or iterations on the system? We look forward to collaborating with you to achieve a streamlined, efficient solution. Best regards, Puru Gupta

@gunslinger

Hi, I’m a Senior Software Engineer who builds secure, high-reliability web automation systems for time-sensitive, multi-account workflows, including large-scale login operations and real-time data retrieval. If I get this project here is the mini pan: - Assess target platforms: auth flows, anti-bot, ToS boundaries, and failure risks. - Build robust browser automation (Puppeteer/Playwright) with session isolation, proxy rotation, retries, and monitoring. - Optimize for real-time performance: barcode retrieval accuracy, data consistency, CI/CD integration, and resilience. I’ve delivered production automation that runs autonomously, scales safely, and supports real-world operations without fragility. If you need reliability under pressure, I’m ready to contribute immediately. Yuda,

@neerajdhameliya

Hello, I’m Niral D, a senior software engineer with 8+ years of experience building large-scale web scraping, automation, and data-driven systems using Python, Node.js, and the MERN stack. I specialize in designing resilient browser automation workflows, secure login handling, and performance-critical backend services for production environments. Portfolio & Past Work ➤ https://www.freelancer.com/u/neerajdhameliya I build fault-tolerant scraping systems using Playwright/Puppeteer, implement proxy rotation and anti-detection strategies, and integrate Python services with MERN-based dashboards and APIs. I’m comfortable working with Azure services, background workers, and CI/CD pipelines, and collaborating directly with technical founders on architecture and priorities. I’m ready to contribute immediately and help stabilize, scale, and evolve your automation platform. Best regards, Niral D

@ZohaibRoy

⭐⭐⭐⭐⭐ Senior Software Engineer for Web Scraping and Automation Solutions ❇️ Hi My Friend, I hope you're doing well. I've reviewed your project requirements and see you are looking for a senior software engineer with expertise in web scraping and automation. Look no further; Zohaib is here to assist you! My team has successfully completed 50+ similar projects in this field. I will create robust scraping modules and optimize data retrieval processes while ensuring compliance and stability. ➡️ Why Me? I bring over 8 years of solid experience in software development, focusing on web scraping and automation. My expertise includes working with tools like Puppeteer, Playwright, and Selenium, along with strong skills in proxy management and data consistency. Moreover, I have a strong grip on cloud environments like Azure and CI/CD practices. ➡️ Let's have a quick chat to discuss your project in detail. I can provide samples of my previous work, showcasing my capabilities in building efficient scraping systems. I look forward to discussing this with you in our chat. ➡️ Skills & Experience: ✅ Web Scraping ✅ Browser Automation ✅ Data Aggregation ✅ Proxy Management ✅ Performance Optimization ✅ CI/CD Practices ✅ Python Programming ✅ JavaScript/TypeScript ✅ Azure Function Apps ✅ Blazor WebAssembly ✅ System Monitoring ✅ Problem-Solving Waiting for your response! Best Regards, Zohaib

@softsolution2000

With over 15 years of experience in software development, my expertise in JavaScript, Python, Django, Node.js, and Express JS makes me a great match for the Senior Software Engineer (Scraping / Web Automation) project. I am confident in my ability to design, build, and maintain robust scraping and web automation modules, optimize performance, and collaborate effectively with your team. I am willing to adjust the budget based on the project scope and ensure to deliver within your requirements. Looking forward to discussing the details and starting the project to showcase my commitment. Please go through my profile to see my work history. Thank you.

@OutsourceMan

⭐⭐⭐⭐⭐ Dear Valuable Client, CnELIndia, in collaboration with Raman Ladhani, is well-positioned to deliver this project successfully. We bring extensive experience in designing and maintaining high-volume web scraping and browser automation systems using Playwright, Puppeteer, and custom headless solutions. We can implement robust proxy rotation, fingerprinting, and anti-detection strategies to ensure reliability, while leveraging Azure Function Apps and Windows background services for scalable, fault-tolerant task orchestration. Our team excels at building lightweight Blazor WebAssembly interfaces, integrating real-time data pipelines, and optimizing performance across distributed scraping jobs. Close collaboration with your team will allow us to align on priorities, architecture decisions, and CI/CD improvements, ensuring timely, secure, and resilient delivery of the event access management system. We are ready to start immediately and ensure high technical quality, stability, and operational excellence.

@Microlent

I’ve read this carefully, and this is the kind of system I’ve spent years working on: time-critical, automation-heavy, adversarial environments where reliability matters more than theoretical purity. What you’re describing isn’t web scraping in the hobby sense. It’s session-aware automation at scale, where proxy behavior, browser fingerprints, orchestration timing, and failure recovery are the product. That distinction matters, and it’s where most systems fall over. I’m comfortable working in small, senior teams where autonomy is expected and communication is direct. I don’t need layers of process to stay productive, but I do care about clean boundaries where they matter. Relevant background summary • 8+ years building production systems • Extensive experience with Playwright, Puppeteer, Selenium, and custom browser automation • Deep understanding of HTTP, cookies, sessions, headers, fingerprinting, and detection vectors • Designed and operated distributed, fault-tolerant scraping systems under real business pressure • Worked across C#, TypeScript/JavaScript, and Python • Hands-on with Azure and CI/CD pipelines • Native English, comfortable working directly with technical founders I also take the compliance and longevity aspect seriously. Sustainable automation is about understanding boundaries, not constantly fighting them. Happy to continue the conversation if this aligns. Best regards, Jenifer

@technosystem

With over 8 years of software development experience, I have honed my skills in software engineering, particularly in web scraping and browser automation utilizing a variety of platforms such as Playwright, Puppeteer, Selenium, and custom headless browsers. In fact, it's worth noting that one of my published Android apps involved scraping data from different marketplaces. The depth of my acquaintance with proxy management and fingerprinting techniques ensures I can provide a reliable and robust system for high-volume data retrieval. Moreover, I've developed on diverse backend languages like Python and JavaScript which perfectly aligns with your 'flexibility welcome' approach. As CI/CD is one of your requirements, let me draw your attention to my experience working on blockchain-based platforms; this necessitated tight version control and frequent deployment. My exposure to the cloud environments (Azure in particular) will also smoothly blend with the project demands on task orchestration through Function Apps. Working in small collaborative teams is not just an experience but a preference for me as I believe it fosters ownership and innovation. My multi-disciplinary background coupled with solid communication skills makes sure I understand your needs clearly and collaborate effectively with other team members such as the technical founder you mentioned. Let's make this project soar!

@LiveExperts

Hello, With my extensive experience as a senior software engineer, I am perfectly positioned to navigate the intricate web scraping and automation environment that your project demands. Harnessing my skills from Python and JavaScript to Azure and AWS, I have successfully built robust scraping modules and automated browser-driven data collection systems in the past. For over 8 years, I have driven value by solving complex problems through clean architectures, be it in large-scale login operations or retrieving time-sensitive data in time-critical environments. My native English proficiency ensures crystal-clear communication when collaborating with clients as well as internal teams – a trait that's particularly crucial for a role that requires ongoing decision-making with the client. As a team player who treasures collaboration, autonomy and understands how to ensure resilience, security, and compliance on target platforms of your system, I am strongly committed to delivering measurable results. Don't waste any more time - reach out today and let's start transforming your vision into an efficient reality! Thanks!

@schoudhary1553

Having spent over 7 years working as a full-stack developer, I have developed a deep understanding of the technical aspects associated with web scraping and web automation. Throughout my career, I've amassed a broad skill set that encompasses Python, Javascript/TypeScript, C#, among others which offers me the necessary flexibility to adapt to any project's requirement. As a data-driven individual, I perfectly recognize the significance of real-time event access management and have substantial experience creating the kind of robust scraping and web automation modules required for this project. My clients have often commended me for my ability to prioritize clean architecture without compromising pragmatic problem-solving. This would be invaluable in ensuring a resilient system that guarantees performance, automation, and stability - all characteristics integral to our intended end-product. Additionally, I'm well-versed in CI/CD improvements and operational reliability strategies which will further enhance our workflow.

@Reflexlogic

Hello, We are a software engineering company specializing in web scraping, browser automation, and high-reliability data systems. After reviewing your requirements, we’re confident we can support this project by assigning a dedicated senior software engineer with deep expertise in automation and distributed scraping architectures. For this engagement, we would assign a senior engineer (8+ years experience, native English) who will work directly with your technical founder and internal engineers as an integrated part of your team. Our developers are comfortable operating autonomously in small, fast-moving environments while maintaining strong communication and delivery discipline. Relevant Experience & Technical Fit Our team has built and maintained business-critical automation systems very similar to what you described, including: * High-volume, secure login automation across multiple accounts and platforms * Browser-based scraping using Playwright, Puppeteer / PuppeteerSharp, and Selenium * Advanced proxy rotation, fingerprinting, and anti-detection strategies * Robust handling of sessions, cookies, and HTTP traffic at scale * Fault-tolerant scraping pipelines designed for time-sensitive data retrieval We have hands-on experience with the full stack outlined in your project: * Web scraping modules (Playwright, PuppeteerSharp) * Azure Function Apps for serverless orchestration Looking forward to discussing further Thanks

@hireageek

Hi there, I am a seasoned software engineer based in California with over 8 years of experience specializing in web scraping and automation. I’ve successfully delivered robust solutions that improve data acquisition processes, particularly in environments demanding technical depth and adaptability, just like the one you described. I understand the critical nature of automating and streamlining data aggregation from ticketing platforms, and I am confident in my ability to design, build, and optimize the required modules for your project. My expertise includes extensive work with PuppeteerSharp and Playwright for browser automation, as well as a strong grasp of proxy management methods and cloud architecture, particularly in Azure. I thrive in collaborative settings and am eager to work closely with your team and the client to ensure that we meet the technical and business objectives. Let’s discuss how I can start contributing right away to this exciting project. What specific challenges do you foresee in the current scraping implementation that you'd like me to address? Thanks,

@teodorgeorge

Hello, I have extensive experience in web scraping and automation with strong skills in Playwright, Puppeteer, and proxy management, making me well-suited for this role focused on secure, high-volume data retrieval. I am comfortable working both independently and collaboratively with teams and clients to deliver reliable, scalable solutions that fit the technical and business requirements. With knowledge in multiple backend languages and cloud environments like Azure, I can contribute to system stability and performance improvements while ensuring compliance and innovation. I look forward to helping build a robust, fault-tolerant automation system that supports real-time event access efficiently. Thanks, Teo

@corpmember29

HELLO, I HAVE BUILT AND MAINTAINED LARGE-SCALE WEB SCRAPING AND AUTOMATION SYSTEMS USED IN PRODUCTION, DESIGNED TO BE RELIABLE, STEALTHY, AND TIME-CRITICAL. I am a senior software engineer with 8+ years of hands-on experience in web scraping and browser automation, working with Playwright, Puppeteer, Selenium, and custom automation flows. I have built fault-tolerant systems that handle secure logins, session management, proxy rotation, fingerprinting mitigation, and high-volume data extraction under strict timing constraints. **** You may follow the project's development using the tracker. I am available for work 40 hours a week **** I am comfortable owning end-to-end components—from automation modules and background services to cloud-based orchestration (Azure/AWS), CI/CD, and lightweight web interfaces. I understand HTTP internals, cookies, browser behavior, and anti-detection strategies, and I focus on performance, stability, and long-term maintainability. I thrive in small, fast-moving teams, collaborate directly with technical founders, and balance clean architecture with pragmatic delivery. I can contribute immediately to improving reliability, scalability, and operational resilience of your system while aligning closely with business priorities. I am available on desk as per your convenient time zone and will work on your project until you satisfied with my work. Awaiting your positive response. Thanks Christina