System to crawl thousands of rss feeds.


Im in need of a script which crawls rss feeds...

I have all the rss urls in a database, i have tryed a program called

Magpie RSS - PHP RSS Parser ([url removed, login to view]) but it cant crawl certain rss url like ( [url removed, login to view] ).

So what does the system need?

1. Should be able to crawl atleast 95% of the url i have in my database, each rss feed is linked to a user id.

2. It should rank rss feeds depending on how often they type new articles, so the crawl script doesnt crawl a rss feed everyday if the writer only types once a month, makes sence?.

3. If it cant crawl a url it should jump over it and try a new one.

4. The script should crawl a maximum of 10 rss feeds each time the script runs. I will set it in cronjobs to run every 5 minutes.

5. Your allowed to use the magpie script if you mod it to work with 95% of the urls.

6. i will send you a txt message with all the urls then its up to you to create a database for it since i cant give you access to a live website.

7. it should crawl (link to the article) (title) (the article (1000 letters max))and the date/time.

Beceriler: Veri Girişi, PHP

Daha fazlasını gör: crawl rss feeds, writer access com, what is linked in, to the maximum, system one, php writer program, maximum max, im writer, how to create website for http and url, how to create database program, how to create blogspot, data entry work linked in, data entry .blogspot, create blogspot website, create blogspot, 3 types of data entry, thousands rss feeds, rss php crawl, php crawl rss feeds, php crawl rss feed

İşveren Hakkında:
( 23 değerlendirme ) Dalby, Sweden

Proje NO: #99328



Hi! I can help you with this. Please check the PMB for a demo site. Iván

%selectedBids___i_period_sub_7% gün içinde 65%project_currencyDetails_sign_sub_9% %project_currencyDetails_code_sub_10%
(19 Değerlendirme)

Bu iş için 5 freelancer ortalamada $83 teklif veriyor


Please check your PM

in %bids___i_period_sub_35% gün içinde100%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(69 Değerlendirme)

Because that is an atom feed, not an rss feed.

in %bids___i_period_sub_35% gün içinde100%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(22 Değerlendirme)

I'm a expirenced programmer in html, css, php and mysql for about 4 years now. I'm a real expert in these kind of things. I also make PHP website, which can easaly found by searchenginges. I can start right now if you Daha Fazla

in %bids___i_period_sub_35% gün içinde100%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(1 Yorum)

Dear Sir/Madam Broadband Business Corporation (BBC) is one of the fastest growing IT Enabled service provider. BBC provides Document Life-Cycle and Business Intelligence Solutions to Corporations and Legal Professio Daha Fazla

in %bids___i_period_sub_35% gün içinde50%project_currencyDetails_sign_sub_37% %project_currencyDetails_code_sub_38%
(0 Değerlendirme)