BeautifulSoup Jobs

I need a small, self-hosted agent that watches publicly available news, filings and press releases for any new M&A activity in the US mortgage industry, then posts a message to a dedicated Slack channel the moment a deal appears. Each alert must include the companies involved, the announced or estimated transaction amount and the date of the deal, so my team can act on it immediately. Only two tools are at my disposal: Copilot (for coding assistance) and our existing Slack workspace. I do not want to buy or subscribe to any premium data feeds, so the solution must rely on open-source sources—free RSS feeds, publicly indexed sites, Edgar filings, or other no-cost endpoints—plus standard libraries (e.g., Python requests, BeautifulSoup, feedparser) and Slack’s incoming-...

I will supply the full URL of the target site and need an automated crawl that captures every internal page, pulls out all text and every embedded image, and records the direct URLs discovered along the way. Rather than a flat file hand-off, the collected material should be transferred into another website I specify, maintaining the original page structure so that links, headings, and image references remain intact. Please handle the job with a reliable stack such as Python, Scrapy or BeautifulSoup for the crawl, and use whatever bridge—REST, direct database import, or CMS API—you find most efficient for moving the scraped data into the destination site. Deliverables • A reproducible script or crawler project. • Full text and image assets migrated to the destinati...

I need a clean, well-commented script that visits a specific online business directory, extracts every company name together with its publicly listed email address, and then saves the results to a single CSV file. At the moment I’m undecided about whether I’ll reuse the code for other sites later, so please structure it in a way that wouldn’t make future tweaks painful—modules or clear functions will be appreciated, though it doesn’t have to be a full-blown framework. The directory requires no login, but it does paginate the listings. Your solution must handle that pagination automatically, avoid triggering rate-limits, and finish with a CSV that has at least two columns: CompanyName and Email. I’m happy with Python (requests, BeautifulSoup, Selenium, ...

I need a clean, repeatable script that goes through a target classified site, collects full information—titles and descriptions, prices with current availability, and all associated images—and pushes every record straight into my existing SQL database. Product information is the sole focus; other content such as user reviews or contact details is out of scope for now. The script should: • Loop through every product URL on the site (pagination included) • Extract the three data points above with accurate parsing and basic validation • Download or reference images so they can be stored or linked from the SQL tables • Insert or update rows in the database without creating duplicates, using an upsert strategy I am comfortable provisioning a stagin...

I need all text content pulled from a website and compiled into an Excel workbook each week.

Ho bisogno di un programmatore Python che sappia creare uno scraper affidabile capace di raccogliere, ogni settimana, i dati completi dei volantini dei supermercati nell’area di Cesena. Al momento mi interessano in modo esplicito Conad, Coop, DPiù, ma sono aperto a tutti gli altri punti vendita che pubblicano volantini online nella stessa zona. Cosa deve fare lo script • Visitare i siti e/o i PDF dei volantini, identificare ciascun prodotto e salvarne: – Nome esatto – Prezzo in offerta e, se indicato, prezzo originale – Categoria merceologica – Supermercato di provenienza e periodo di validità dell’offerta • Ritagliare l’immagine del prodotto e salvarla in locale in formato JPEG. • Popolare un dat...

I need a script that visits the California State License Board site, drills down into every contractor record, and captures every publicly visible field—license number, classifications, bonding, personnel, status history, contact info, everything. The scraper must handle pagination, search-form quirks, and any soft-rate limiting the site imposes so the run finishes without manual stops or captchas blocking the flow. Once gathered, the data should be written to a single CSV file, overwriting the previous file on each run so I always have a fresh snapshot. The entire process has to trigger automatically every 24 hours (cron, systemd timer, Cloud Scheduler—whatever you prefer) and run headless on a Linux VPS I’ll provide. I am fine with Python (requests, BeautifulSoup, Sc...