I need an online application that will regularly scrape a set of forums for new threads.
1. Scrape certain forums for new threads selling domains, scrape each new thread for the domain being sold.
2. Store data about each thread in a SQL database.
3. Interface with other online tools (Google toolbar, who-is-search, etc.) to return info about the domain — store that data in the SQL database as well.
4. Provide a user interface to search for threads and view the data from the SQL database for threads matching the search parameters.
Application needs to run on a server, not a desktop application.
Application needs to run in such a way as to not get banned by the forums.