I gang

System to crawl thousands of rss feeds.


Im in need of a script which crawls rss feeds...

I have all the rss urls in a database, i have tryed a program called

Magpie RSS - PHP RSS Parser ([url removed, login to view]) but it cant crawl certain rss url like ( [url removed, login to view] ).

So what does the system need?

1. Should be able to crawl atleast 95% of the url i have in my database, each rss feed is linked to a user id.

2. It should rank rss feeds depending on how often they type new articles, so the crawl script doesnt crawl a rss feed everyday if the writer only types once a month, makes sence?.

3. If it cant crawl a url it should jump over it and try a new one.

4. The script should crawl a maximum of 10 rss feeds each time the script runs. I will set it in cronjobs to run every 5 minutes.

5. Your allowed to use the magpie script if you mod it to work with 95% of the urls.

6. i will send you a txt message with all the urls then its up to you to create a database for it since i cant give you access to a live website.

7. it should crawl (link to the article) (title) (the article (1000 letters max))and the date/time.

Færdigheder: Dataindførsel, PHP

Se mere: crawl rss feeds, system one, php writer program, maximum max, im writer, data entry work linked, create blogspot website, thousands rss feeds, rss php crawl, php crawl rss feeds, php crawl rss feed, crawl rss url, script crawl rss, crawl rss database, php thousands feeds, crawl rss atoms, crawling atom feeds, crawl sites rss feeds, data entry blogspot, rss, create blogspot, crawl data, work database letters, rss atom php, everyday writer

Om arbejdsgiveren:
( 23 bedømmelser ) Dalby, Sweden

Projekt-ID: #99328

Tildelt til:


Hi! I can help you with this. Please check the PMB for a demo site. Iván

$65 USD in 3 dage
(19 bedømmelser)

5 freelancere byder i gennemsnit $83 for dette job


Please check your PM

$100 USD in 3 dage
(69 bedømmelser)

Because that is an atom feed, not an rss feed.

$100 USD in 2 dage
(22 bedømmelser)

I'm a expirenced programmer in html, css, php and mysql for about 4 years now. I'm a real expert in these kind of things. I also make PHP website, which can easaly found by searchenginges. I can start right now if you Mere

$100 USD in 3 dage
(1 bedømmelse)

Dear Sir/Madam Broadband Business Corporation (BBC) is one of the fastest growing IT Enabled service provider. BBC provides Document Life-Cycle and Business Intelligence Solutions to Corporations and Legal Professio Mere

$50 USD in 7 dage
(0 bedømmelser)