I need a web crawler designed for my Internet Research business. It should be able to aggregate social media content from all public feeds including microblog, blog, social network and video portals using their APIs. It should be relatively easy to use and able to gather content in a range of languages.
What I already have versus what the provider will build: I already use SM2 by [url removed, login to view] but would prefer to bring technology such as this in house.
Specific expertise that I am seeking: You should have experience in building web crawlers that operate in multpile languages.
Timeframe for delivery: I am looking to have this technology in operation within four to five weeks.