This is a simple project for anyone used to scraping sites.
I need a web application that will regularly scrape one forum for new threads:
1. Scrape one forum for new threads selling domains. Scrape each thread for the domain being sold plus other available data (data is usually in a specific format in each thread)
2. Verify age of the domain with [url removed, login to view]
3. Store the data (including domain age) in a SQL database.
Application needs to run on a server, not a desktop application.
Application needs to run in such a way as to not get banned by the forums.