
Closed
Posted
Paid on delivery
I have a series of websites whose pages all share a consistent HTML structure. I need the visible text content extracted, cleaned of markup, and inserted into an existing SQL database that I will provide (schema and credentials ready). The workflow I picture is straightforward: crawl each page, parse the HTML for the specific elements I’ll identify (headings, paragraphs, and a couple of custom tags), normalise any odd characters, then bulk-insert the results so the database is immediately query-able. A repeatable solution matters because I’ll be running the same process weekly as the sites update. I’m comfortable if you build the scraper in Python—BeautifulSoup, Scrapy, or Selenium are all fine—or you can propose another language or library you prefer, as long as it reliably handles pagination and throttles requests to stay respectful of the hosts. Deliverables: • A well-commented script or small codebase that performs the crawl, parse, and SQL insert in one run. • A SQL file (or direct push) showing a sample run so I can verify field mapping. • Brief setup notes so I can schedule it as a cron job on a Linux server. Accuracy and efficiency are more important to me than fancy reporting, so keep the output lean and focused on the text fields. Let me know any clarifications you need, and we can get started right away.
Project ID: 40533942
30 proposals
Remote project
Active 2 days ago
Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
30 freelancers are bidding on average ₹1,154 INR for this job

Hello! I am writing to express my interest in your web scraping project using Python. With over 20 years of experience in software development and a strong foundation in Python, web scraping, and Selenium, I am confident in my ability to deliver a robust and efficient solution tailored to your needs. My expertise includes developing scripts for data extraction and automation, leveraging Python and Selenium to navigate dynamic websites and extract structured data. Also, I am familiar with SQL very well, therefore storing data into SQL DB will be solved. I would welcome the opportunity to discuss your requirements in detail and provide a tailored approach to this project. Please let me know a convenient time to connect. Best regards, Ivan V.
₹1,047 INR in 1 day
7.3
7.3

Have over 18 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered results as per your requirement, In the format you want. You can also ask for data into a particular format - Excel, Json, Mysql, Databases, XMLs, you name them. Further Can help you with integrating it with ur databases, Can create json outputs. We are not only good with scraping but also with the tools that u may need after that. We can help you build you softwares round the data we have 99% Data Accuracy. We have Duplicate finder. etc., We can help with Statistics on the data We can help with creating Api's front the data We can create Softwares to manage that data We can build Sites round the data
₹1,000 INR in 1 day
6.9
6.9

hello sir i am very good with data scraping work i have already done this kind of work. please give me a chance
₹1,050 INR in 7 days
7.1
7.1

Hi sir, Thank you for giving opportunity for biding... we have gone through your requirements and we can do your Data scraping and inserting to a SQL database using Readymade Python code according to your exact requirements. Why You Need To Go With Us? And What Special you get with us. • Your vision = Our mission • Your idea + Our expertise = Winner on Web • Cutting edge web technology & design • Innovative, Cost effective & Customized service • Pragmatic Approach • Constant communication with clients • Consistent performance • On-time delivery • Maintenance of global quality standards • Your online business + Our experience = Your success Python, Data Analytics, Data Science Portfolio IoT Data Analysis for Dairy Refrigerator Temperature Monitoring Real-time Object Detection using OpenCV and YOLO Supply Chain Management System Enterprise Data Warehouse Implementation Cloud Data Lake Migration Web Application Development for Wind Turbine Performance Prediction Data Analytics Platform for Supply Chain Optimization AI Bill System AI Try Dress
₹1,500 INR in 2 days
6.4
6.4

Hi, I can build a reliable Python based solution to crawl your websites, extract the required text elements, clean and normalize the content, and insert it directly into your SQL database. The script will be well structured, commented, and designed for repeatable weekly execution, including pagination handling, request throttling, error logging, and bulk database inserts. I’ll also provide setup instructions and a sample run so you can easily deploy it as a scheduled cron job on your Linux server. Best regards, Md Shamim
₹1,050 INR in 1 day
5.7
5.7

As an AI and automation enthusiast, I couldn't be more excited about your project. Having extensively worked with data processing, database management, HTML, Python, SQL, and web scraping over the years, I'm confident in my ability to deliver a clean, efficient solution tailored specifically to your needs. My experience building intelligent systems and automations at companies like Google and Apple has given me a strong foundation in managing structured workflows and designing repeatable processes perfect for your weekly updates. I fully understand and appreciate the importance of accuracy and efficiency in a workflow such as this one. With this in mind, I assure you of two things: first, I'll construct a python script or codebase that effortlessly performs the crawl, parses, and inserts data into your provided SQL database. Second, I'll leverage my knowledge of popular scraping libraries such as BeautifulSoup, Scrapy, and Selenium to ensure the entire process is user-friendly, efficient, and respectful of all hosts while handling pagination. To guarantee your confidence in my work even before we start the project,I will provide you with a SQL file confirming successful field mapping prior to bulk-insertion in the database. Furthermore,I will create setup notes so that you can easily schedule it as a cron job on your Linux server.
₹1,050 INR in 7 days
5.7
5.7

Hi, I can build a reliable Python scraper that crawls your websites, extracts and cleans the required text elements, handles pagination, normalizes content, and inserts the data directly into your existing SQL database. The solution will be fully documented, cron-job ready, and designed for weekly automated runs with proper throttling and error handling. Approximately how many websites/pages need to be processed each week, and what database are you using (MySQL, PostgreSQL, SQL Server, etc.)? Thanks
₹1,200 INR in 2 days
4.9
4.9

Hi, I can build a clean and repeatable Python scraper to crawl the provided websites, extract the required visible text fields, clean/normalise the content, and insert the results directly into your existing SQL database. I have good experience with Python, BeautifulSoup/Scrapy, web scraping, data parsing, SQL integration, pagination handling, and Linux automation. I will provide a well-commented script, sample SQL/output for verification, and brief setup notes so you can run it weekly using cron. I will keep the solution simple, efficient, and easy to maintain for future updates.
₹1,500 INR in 2 days
5.1
5.1

Crawling with a fixed HTML structure means I map exact selectors once, then parse and clean headings, paragraphs, and the custom tags you list. Bulk-insert into your SQL database is simple—no need for ORM, just direct parameterized queries. Repeatability means the whole process goes in one Python script with flags for pagination, rate throttle, and field normalization. I built a weekly scraper for a classified ads portal using BeautifulSoup for parse, requests for crawl, and psycopg2 for PostgreSQL DB writes. Code was set up to run as a cron job on Ubuntu; clean comments, setup guide, and a working sample output included. Will you provide one example URL plus the field mapping (table and columns) before handover? Pradeep
₹1,050 INR in 7 days
4.6
4.6

Hi there, The moment I read "Data scraping and inserting to a SQL database using Readymade Python code.", I knew it was a strong match for exactly what we do best. What stood out to me is how clearly you’ve described what you want — and clarity like that is where we deliver our very best work. From your brief I can see this involves scraping, web scraping, data processing — all areas we handle in-house. We specialise in Python, Data Processing, SQL, Web Scraping, which lines up directly with what you need. How we'd approach it: - Define the exact fields, sources and output format - Build the collection / processing pipeline - Validate accuracy and clean the data - Deliver in your preferred format with a short summary From kickoff to final handover, I’ll keep things transparent, on schedule, and squarely focused on your goals. Happy to jump on a quick chat to walk through scope and timelines whenever suits you. Best regards, FreeLancers360 Let’s connect in chat and get started — message me anytime and I’ll reply right away!
₹600 INR in 7 days
4.3
4.3

Hi, I’m Armin Nikdel. I’d build this as a small Python scraper using requests and BeautifulSoup by default, with Selenium only if any pages require rendered content. The script would crawl pagination, extract the specified headings, paragraphs, and custom tags, normalize the text, and bulk-insert clean rows into your existing SQL schema. For reliability I’d use throttled requests, parameterized inserts, least-data logging, and a sample run/SQL output so you can confirm the field mapping before scheduling it weekly. I can do this for INR 1500 with delivery around 12 days, including concise Linux cron setup notes. One thing I’d confirm before starting: should the weekly runs append all extracted rows, or upsert/update existing records based on URL or another unique key?
₹1,500 INR in 12 days
4.4
4.4

I can build you a clean, reliable Python scraping pipeline that crawls your websites, extracts structured visible text (headings, paragraphs, custom tags), normalizes the content, and directly inserts it into your SQL database.
₹1,050 INR in 2 days
3.8
3.8

As a seasoned data scientist, SEO specialist, and data analyst with in-depth knowledge of Python and SQL, I am more than equipped to help you with your project. Having worked on similar tasks involving data scraping and inserting it into an SQL database, I understand the importance of a clean and efficient workflow. My experience in handling HTML structures using libraries like BeautifulSoup, Scrapy, and Selenium will ensure a meticulous and repeatable solution for your crawling and parsing needs. Accuracy matters more than anything when it comes to data scraping, and my background in data analytics has honed my eye for detail. Rest assured that I'll normalize any odd characters present while thoroughly scrubbing away any unwanted markup. My ability to handle pagination and throttle requests efficiently will also guarantee that we stay respectful of the host sites throughout the process. In addition to solid technical skills, I believe communication is key to successful collaboration. You'll find that I keep comprehensive notes and documentation to keep you in the loop at all times. During the project, I will provide you with a fully-commented script or codebase for your review so you can verify field mapping first hand. Let's transform your websites' structured htmls into actionable insights together!
₹600 INR in 1 day
3.3
3.3

I see you need data scraping from websites with a consistent HTML structure. I have solid experience with Beautiful Soup and Python to get the job done efficiently. What's your timeline for this project?
₹1,080 INR in 7 days
2.5
2.5

As an AI & Data Engineering Specialist with expertise in Python and SQL, I'd be a great fit for your data scraping and database insertion project. My experience of building scalable, production-ready systems aligns perfectly with your requirements. Over the years, I have honed my skills to transform large volumes of data into meaningful insights whilst ensuring accuracy and efficiency, factors you prioritize in this project. I propose using Python with BeautifulSoup to scrape data from the websites you provided. Being comfortable with several libraries like Selenium, Scrapy alongside robust pagination handling and request throttling, I guarantee efficient crawls. Additionally, I've significant experience in normalizing textual data by cleaning off marked up content - a skill I'll employ here to ensure only relevant text is extracted and inserted into your database. Your vision of having consistent and automated weekly runs aligns well with my core skills as a Cloud Data Engineer. I'm adept at setting up cron jobs on Linux servers which ensures that your scheduled jobs run seamlessly without any hiccups. To further assure confidence in my work, I will provide you with a well-commented codebase that performs all the necessary tasks in one run as well as a sample file reflecting the correct field mapping - so you're comfortably aware of the processes at play. thanks prem golani
₹2,000 INR in 3 days
2.7
2.7

I will extract the visible text content from your series of websites and insert it into your existing SQL database by crawling each page, parsing the HTML for specific elements, normalizing odd characters, and bulk-inserting the results. I will utilize Python with BeautifulSoup to achieve this, handling pagination and throttling requests to respect the hosts. I have previously worked on a similar project, the Attorney Settlement scrapping with AI, where I developed a fully automated data scraping solution, extracting structured insights from websites. In this project, I used BeautifulSoup for efficient HTML parsing and Playwright for automated browser interaction. I can deliver a well-commented script that performs the crawl, parse, and SQL insert in one run, along with a SQL file showing a sample run and brief setup notes for scheduling as a cron job on a Linux server. Can you please confirm the specific elements you want me to extract from the HTML and provide more details about the custom tags?
₹1,190 INR in 7 days
2.1
2.1

I'm a certified AI, Python Automation & Data Analyst, Data scraping specialist with hands-on experience in web scraping, Selenium, Playwright, Flask, n8n workflow automation, and data analysis using Python, R, Pandas, and NumPy. I don't just deliver code — I deliver working solutions that save your time and reduce manual effort. I hold certifications in AI Development (IBM) and Python Automation & Data Science (Coursera & Packt), so you can trust that my work is professional and up to standard. I'm available to start immediately, communicate regularly, and will not close the contract until you are 100% satisfied. Let's discuss your project — feel free to send me a message!
₹1,050 INR in 7 days
2.0
2.0

Hi, I have relevant experience to do this job , i have 8+ years expertise with python , lets connect in chat to discuss further.
₹1,500 INR in 7 days
2.2
2.2

Hello, I can build a repeatable Python scraper to crawl your websites, extract the required visible text from headings, paragraphs, and custom tags, clean/normalize the content, and insert it directly into your existing SQL database. I will use BeautifulSoup/Scrapy depending on the page structure, include pagination handling, request throttling, clear field mapping, and error logging so the process can run weekly without manual work. Deliverables will include a well-commented script/codebase, sample SQL output or direct test insert, and short Linux cron setup notes. I can start once you share the target URLs, element selectors, database schema, and credentials.
₹1,150 INR in 4 days
1.7
1.7

With over a decade of experience as a Full Stack Developer, I've honed my skills in handling data and string manipulation using Python. One of the tasks that best showcases this strength is data scraping from structured HTML, like in your project requirements. Python's libraries like BeautifulSoup can aid us greatly in parsing webpages while maintaining high accuracy. In a project like yours, I understand the importance of a well-commented script, briefing setup notes and sample SQL file or direct push. My flexible approach to coding ensures I document thoroughly for both our future references, including field mapping verification. I've demonstrated my adaptability with a variety of coding languages and libraries which includes Selenium as you specifically mentioned its possibly requirement. Scala or BeautifulSoup suggestively represents my meticulous approach to coding, making them ideal for projects needing clean and focused outputs. Thus, if chosen, I promise unquestionable determination to use my skills and experience to deliver an efficient and accurate solution for your web scraping task.
₹1,500 INR in 2 days
1.9
1.9

Kochi, India
Payment method verified
Member since Aug 5, 2025
₹1500-12500 INR
₹600-1500 INR
₹37500-75000 INR
₹600-1500 INR
₹600-1500 INR
$10-30 USD
₹750-1250 INR / hour
$250-750 USD
₹1500-12500 INR
£10-20 GBP
₹750-1250 INR / hour
$250-750 USD
₹12500-37500 INR
₹12500-37500 INR
₹12500-37500 INR
₹12500-37500 INR
$250-750 USD
$250-750 USD
$10-30 USD
$1500-3000 USD
₹12500-37500 INR
₹1500-12500 INR