
Closed
Posted
I'm seeking a proficient web scraping developer to assist in extracting publicly available news data from various newspaper sites. The data will be formatted as text only, and will need to be populated into a PHP/SQL site that I maintain. Key Responsibilities: - Scrape news data from various sources and format it as required - Implement techniques to overcome anti-scraping measures, including but not limited to: - Dynamic IP address rotation - Using third-party services to solve captchas - User-agent rotation Ideal Candidate: - Extensive experience in web scraping - Proven ability to overcome anti-scraping measures - Proficient in PHP and SQL - Available for 3-4 hours a day over the next 6-12 months The project is built in Symfony PHP I want to work with an INDIVIDUAL, not a company, so please only apply if that applies to you. Also, make the first word of your bid the name of a famous electric car company, so I know you read this. Please include a list of past projects (urls of sites you have built)
Project ID: 38861571
91 proposals
Remote project
Active 1 yr ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
91 freelancers are bidding on average $15 USD/hour for this job

Tesla, Hello Steve, I understand you're looking for a skilled web scraping developer to extract news data from various newspaper sites and format it for your PHP/SQL site. I have extensive experience in web scraping and have successfully implemented techniques to handle anti-scraping measures like dynamic IP rotation and user-agent rotation. I am also proficient in PHP, SQL, and have worked with Symfony. I'm able to commit to 3-4 hours a day over the next 6-12 months, ensuring timely and effective results. I can provide a list of past projects, showcasing my expertise in building similar systems. What specific news sources do you want to scrape, and are there any particular formats or data fields you would like to focus on? Thanks, Muhammad Awais
$25 USD in 30 days
8.9
8.9

Tesla Hello I would be pleased to assist in developing a solution for extracting news data and integrating it into your PHP/SQL site. I think it is a good way to use Python with libraries like BeautifulSoup or Scrapy for web scraping because they are efficient for structured data extraction. Data can then be processed and seamlessly integrated into your site using SQL queries or Laravel's database management for optimal performance. Hope to discuss the details further.
$12 USD in 40 days
8.4
8.4

I am proficient in web scraping and have extensive experience in overcoming anti-scraping measures. With strong expertise in PHP and SQL, I am available for 3-4 hours a day over the next 6-12 months. I have successfully completed similar projects and I am committed to delivering efficient solutions for your specific requirements.
$15 USD in 40 days
8.2
8.2

Dear Steve N., We carefully studied the description of your project and we can confirm that we understand your needs and are also interested in your project. Our team has the necessary resources to start your project as soon as possible and complete it in a very short time. We are 25 years in this business and our technical specialists have strong experience in JavaScript, Web Scraping, MySQL, Symfony PHP and other technologies relevant to your project. Please, review our profile https://www.freelancer.com/u/tangramua where you can find detailed information about our company, our portfolio, and the client's recent reviews. Please contact us via Freelancer Chat to discuss your project in details. Best regards, Sales department Tangram Canada Inc. P.S. As you see from details of your profile, you located in UK (Great Britain). Be informed that our technical offices located in Ukraine i.e. you will be able work with our developers almost in same time zone.
$25 USD in 5 days
8.3
8.3

Hi, I am Senior Python script developer with 10 years of experience. I can scrape your required websites an upload into your required db by python script/bot with your instructions very short time. Can we discuss please? Thanks
$8 USD in 40 days
7.7
7.7

Hello, As a top 4% ranked JavaScript developer on Freelancer with over 10 years of experience in web and mobile app development, I am well-equipped to handle your web scraping project. My past projects include website development using PHP and SQL, which are the skills you require for the project. Not just that, I have extensive proficiency in JavaScript and its frameworks, making me adept at overcoming anti-scraping measures. I'm well-versed in dynamic IP address rotation, using third-party services to solve captchas, and user-agent rotation. The fact that I've already furnished advanced solutions like the one you need in my previous work has given me an edge when it comes to handling anti-scraping measures efficiently. Moreover, professionalism is guaranteed as I'm an individual freelancer dedicatedly providing services for over a decade. This means you not only get my analytical expertise but also my commitment of at least 3-4 hours/day for a significant period. Moreover, being connected with Odoo's network of clients enhances collaboration and knowledge-sharing possibilities for every project. My goal aligns perfectly with yours - ensuring client satisfaction. Embark on this journey of excellence by giving me this opportunity. With Regards! Rekha
$12 USD in 40 days
7.4
7.4

As a dedicated web scraping specialist with years of experience in extracting data from various sources, I would be an ideal fit for your project. My proficiency is not limited to specific websites or data formats; rather, my expertise spans across any publicly available source. I have successfully scraped news data from numerous newspaper sites in the past and have the essential skills to carefully structure and integrate this data into your existing PHP/SQL site. Overcoming anti-scraping measures is one of my greatest strengths, which will prove invaluable for our project. I am adept at employing dynamic IP address rotation, leveraging third-party services to solve captchas, and implementing user-agent rotation - these techniques ensure a seamless scraping process even on sites that employ heavy security measures. Moreover, my proficiency in PHP and SQL aligns perfectly with your project requirements. Having worked on numerous web scraping projects prior to now, I understand the importance of precision and efficiency in this field, and I assure you that these traits define my work style. Operating as an individual freelancer, I can commit 3-4 hours a day over the next 6-12 months to ensure the successful completion of this project. Let's connect and discuss how we can elevate your PHP/SQL site together!
$10 USD in 10 days
7.0
7.0

I read your project description brief and fully understand what you are looking for. I have rich experience in web scraping, with expertise in overcoming anti-scraping measures like IP rotation, captcha-solving, and user-agent rotation. I am proficient in PHP and SQL, including extensive work with Symfony PHP, and I can ensure seamless integration of scraped data into your site. Over the past few years, I have worked on similar projects, and I can provide a detailed list of past work upon request. I am available for 3-4 hours a day and am committed to delivering consistent results over the next 6-12 months. I look forward to collaborating with you on this project. Best regards, Denis
$14.99 USD in 40 days
6.8
6.8

Hello I am an experienced web scraping developer with expertise in overcoming anti-scraping measures, including dynamic IP rotation, CAPTCHA solving, and user-agent management. Proficient in Symfony PHP and SQL, I can seamlessly integrate scraped data into your platform. With a proven track record in similar projects, I am available for 3-4 hours daily to ensure consistent, high-quality delivery over the next 6-12 months. Thanks Anshuman
$11 USD in 40 days
6.4
6.4

Dear Client! Here are some famous electric car companies. Tesla Nissan (known for the Leaf) We are happy to bid on your project. We are a team of expert developers who have expertise in webscraping. Over the last 10+ years, we have developed several websites and achieved excellent feedback from clients. Core skills and experiences: - Skills (Selenium, Scraping with C#/python/java/node.js, chrome extension, Excel) - Interaction with backend - Rest API, JSON, XML, PHP, NODE.js, C#.net - Databases / Data Management - SQLite, MySQL, MongoDB, MariaDB - Google Maps, Geolocation, GPS, Location Tracking - Version Control Tools - GitHub, Bitbucket, GitLab Why us- - Quality work at affordable prices - Strong frontend and flexible backend architecture and database knowledge - Develop applications that support all devices - Delivering product on/before time - Always up-to-date with the latest technologies Looking forward to your response and building a long-term relationship. ➥ Important Note: We do not take any upfront payment—nothing in Advance.
$12 USD in 40 days
6.6
6.6

"TESLA" Hello sir ! I’m interested in assisting with your web scraping project. With over 7 years of experience in JavaScript, web scraping, MySQL, and Symfony PHP, I can help efficiently extract and format news data from various newspaper sites as per your requirements. I have extensive experience in overcoming anti-scraping techniques, such as IP address rotation, CAPTCHA solving, and user-agent rotation, ensuring smooth and continuous scraping. Additionally, I’m proficient in working with PHP and MySQL to populate the scraped data into your system. I can commit to 3-4 hours daily and look forward to collaborating with you on this long-term project. I can provide you the URL links of my past work separately in the chat after connecting. My Portfolio: https://www.freelancer.com/u/ankasky
$15 USD in 40 days
6.2
6.2

Tesla Woon here. I specialize in web scraping and have extensive experience overcoming various anti-scraping measures, including IP rotation and user-agent switching. My background includes projects where I scraped news data and integrated it into PHP/SQL applications, specifically using Symfony. Could you share which news sources you are most interested in and any specific data fields you require? Availability aligns with your requirement for 3-4 hours daily over the next 6-12 months. You can view my past projects on my portfolio at [insert your portfolio link here]. Looking forward to potentially collaborating on this project.,Bid includes placeholder.
$12 USD in 40 days
6.1
6.1

Hello, I understand you're in search of a talented Front-End Developer proficient in React.js, HTML, CSS, JavaScript, Wordpress and capable of crafting responsive and scalable web applications. I can offer comprehensive web development that will serve as a powerful tool in bringing your projects to life, ensuring they are both visually appealing and functionally robust. My expertise in front-end technologies and responsive design align perfectly with your requirements. Thank you Paul
$15 USD in 40 days
5.8
5.8

With a strong background in web scraping, particularly proficient in JavaScript and familiar with MySQL, I am confident that I can assist you in your project to extract publicly available news data. I have prior experience scraping data from multiple sources while implementing efficient techniques to overcome anti-scraping measures. This includes dynamic IP address rotation, using third-party services to solve captchas, and user-agent rotation. Moreover, equipped with extensive experience and a thorough understanding of PHP/SQL, I can ensure seamless integration of the scraped data into your Symfony PHP site. Given my track record of delivering quality solutions within the mentioned timeframe, I am confident that I will be able to offer you 3-4 hours a day for the next 6-12 months. Although my proficiency span beyond Web Scraping, this project aligns perfectly with my skills and experience making it even more compelling for me. Since you are looking for an individual rather than a company, who is committed to quality and efficiency, lets connect and make this project a reality!
$15 USD in 40 days
5.7
5.7

Suzuki Hi there! As an experienced web scraping specialist, your project truly piques my interest. My seven years as a senior engineer have equipped me with the skills to overcome even the most complex anti-scraping measures. From dynamic IP rotation to third-party solution captchas, I can ensure seamless data extraction for your PHP/SQL site in no time. But it goes beyond just scraping; it's about delivering value throughout your 6-12 month-long journey. So be it implementing strategies to abide by ethical boundaries or offering regular updates on the work progress, count on my dedication and professionalism to ensure optimal results. Let's steer your project towards success together!
$15 USD in 40 days
5.7
5.7

Nice to meet you snurse, My name is Anthony Muñoz, I express my interest in working on your project after carefully reading the requirements and concluding that they match my area of knowledge and skills. I am currently the lead engineer for the IT agency DSPro and I have more than 10 years of experience in the field. I have successfully completed a large number of similar jobs and I consider your project to be a challenge in which I would like to work and be able to make it a reality. Please feel free to contact me, it will be my pleasure to help you. I greatly appreciate the time provided and I remain attentive to any questions or concerns. Greetings
$32 USD in 40 days
5.8
5.8

Hi Steve N. I am Leo Yeung from Hong Kong who has over 8 years of experience in Software development. I'm really pumped about this opportunity! I have checked your job description for Web Scraping Expert for News Data and Flight Data - Updated. I recently led a project with similar challenges and nailed it. I am very proficient in MySQL, Symfony PHP, JavaScript and Web Scraping, and I'm ready to bring my skills and energy to your project. I can deliver you 100 % satisfied result within your deadline. I would be delighted to have a brief chat to discuss the project further. Thank you for considering me for this opportunity, and I look forward to working together with you on this project. Let's achieve your goal together! Best regards, Leo Yeung
$22 USD in 35 days
5.4
5.4

As a tenured Full-Stack Developer adept in Web Development, JavaScript and MySQL, I am confident that my extensive experience aligns perfectly with your project objectives. Over the past decade, I have gained a profound understanding of web scraping techniques and have consistently overcome anti-scraping measures. From rotating IP addresses to incorporating third-party services for captcha-solving, I possess hands-on experience in applying these crucial tactics effectively. Moreover, my proficiency in PHP, SQL and deep familiarity with the Symfony PHP framework (on which your project is built) will be particularly valuable for this assignment. Whether it's extracting news data or populating it into your existing database, I have proven skills in parsing and formatting the information accurately for seamless integration. Additionally, my availability for 3-4 hours per day over the next 6-12 months ensures that your project will receive unwavering dedication. Let me leverage my skills and background not just for the assigned tasks at hand but also for the long-term success of your PHP/SQL site. Rest assured, when you choose me, you are choosing a seasoned professional committed to ensuring the highest quality deliverables as we navigate the intricacies of web scraping together.
$12 USD in 40 days
4.8
4.8

Hello Steve N., We went through your project description and it seems like our team is a great fit for this job. We are an expert team which have many years of experience on JavaScript, Web Scraping, MySQL, Symfony PHP Please come over chat and discuss your requirement in a detailed way. Regards
$12 USD in 7 days
5.1
5.1

Good Day, Could you clarify which newspaper sites you’re interested in scraping? Additionally, for effective data handling, I’d recommend employing IP rotation and advanced captcha-solving techniques to ensure uninterrupted data access. With over 10 years of hands-on experience in web scraping, I specialize in developing robust solutions that navigate anti-scraping measures efficiently. I’m proficient in PHP and SQL, and can seamlessly integrate scraped data into your Symfony PHP site. I’ve successfully completed similar projects, including scraping data from news outlets and populating it into custom databases. I am available for 3-4 hours daily and can commit to the project for the next 6-12 months. Look forward to hearing from you. Best regards, Imran Arshad
$15 USD in 40 days
5.1
5.1

London, United Kingdom
Payment method verified
Member since Apr 2, 2014
£10-15 GBP / hour
£5-10 GBP / hour
$8-15 USD / hour
$8-15 USD / hour
£10-15 GBP / hour
$250-750 USD
£10-20 GBP
$8-15 USD / hour
$250-750 AUD
£20-250 GBP
$30-250 AUD
$250-750 USD
$750-1500 USD
$75-150 CAD
₹600-1500 INR
$10-30 USD
$250-750 USD
$30-450 NZD
$15-25 USD / hour
₹1500-12500 INR
₹100-400 INR / hour
₹12500-37500 INR
€3000-5000 EUR
$30-250 USD
£250-750 GBP