I need a spider/crawler that will go out to the web and get blogs, based on keywords, category, etc and write the info to a file for our database. I would need the source so we could modify it for our needs. It would also have to be multi-threaded, work on a windows server platform.
3 freelancers are bidding on average $267 for this job
We can do it for you. My company have more experience with crawler.