İptal Edildi

Web Robot - Media Type Indexer

I need a web robot to gather links from web pages and store the information in a database.

Links to HTML Documents and RSS Feeds will be followed and data will be collected about the new document.

The following from each page will be collected:

- Document Type

- Domain Name

- Url String (Relative to the domain)

- Query String

- Date / Time visited

- All outgoing links from that page, indicating the Media Type of the subsequent page (includes type and version where applicable).

Document Types are:

- HTML Document, RSS Feed, Image, Video, email Address, File download, etc..

Must follow 'courteous' robot ettiquette:

- Adheres to [url removed, login to view] inclusions / exclusions

- Browses pages at a comfortable pace - does not overload a single site with multiple hits at once.

- Tracking - knows when a page was last visited, only re-visits a site at a given interval

- Identifies itself properly (configurable agent name)


- Must be built using C#.NET.

- Runs as a service.

- Must use MySQL database.

- May use / refine existing Open Source Software - developer to provide reference to source location and licenses.


- Working application

- All source code.

Beceriler: .NET, Windows Masaüstü

Daha fazlasını gör: web service developer, web pages in html code, web code html, web code developer, web and software developer, type of web developer, source code technologies, software developer download, site web from developer, rss indexer, robot name, pace technologies, open source robot, name the robot, name that robot, name of the robot, i web video, i net technologies, i need a web application developer, html site technologies, file download service, download mysql developer, developer application web, database technologies, type indexer

İşveren Hakkında:
( 7 değerlendirme ) Ajax, Canada

Proje NO: #196947

1 freelancer is bidding on average $110 for this job


This will be my first freelance [url removed, login to view] i wont require much of a payment.

in %bids___i_period_sub_35% gün içinde110%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(0 Değerlendirme)