I am looking for a program which will visit websites based on entered keywords and find emails from these sites after crawling the site and finding a mailto. The program will then allow me to export as a CSV file all of the email addresses.
This application shall be ran locally from my PC, by using a self extracting exe file. The program at this time only needs to use Yahoo, MSN and Google, but needs the ability to be upgraded later if I need.
The email extractor will need to visit ALL pages of a given website to locate an email address by doing a search on an 'at' symbol, mailto: within the source. Any other methods to discover email on websites can be discussed.
Additionally, the program needs to also be able to do this as an option, set in preferences (ie 'Follow out to other sites?':
1. I enter in a target website.
2. The program goes through all pages of that website and follows all links out. When it follows any link out to a different domain, it then takes the email address from that other domain.
3. The program must be able to handle large sized websites with this feature and must be fast.
Several website do not list their contact email and when this is the case it shall crawl [url removed, login to view] or similar site and try extracting the address from here.
In the event the email does not exist on the website it will do a look up using WHOIS database (such as [url removed, login to view]), and if found there then it adds the URL and email to the above file, otherwise a second file is created with just the URLs listed.
We are also looking for the ability to automatically and safely send mails to the addresses found safely and securely, but this will be a different bid which we will talk about once this first project is in place.