Multiple RSS feed aggregation script.
What I have already: I have a small php script that uses Simplepie to read multiple RSS feeds. The script reads all the feeds and combines the articles it pulls down and organizes them by date. Does a word count to ensure they are over 300 words and then outputs that into a static file. here it is output of this script - [url removed, login to view] - view source and you'll see the CSS and jquery I'm using to formatting and auto scroll function. CRON runs a script (that you can use for ideas) every thirty minutes, this is what updates the list of articles from the RSS feeds. I have website display the static file on their website by using an iframe - this makes it a widget - see sample image attached for end result..
Why I need you: The script I have now isn't really efficient and I'm not sure it's scalable to 500+ websites. My current script doesn't use a predefined thumbnail nor does it use mySQL to store source RSS url. It also doesn't limit the widget to one article per website, per pull (the cron that runs every 30 minutes) - it also doesn't utilize Simplepie cache which needs to be done so the script will run much faster.
End result: An aggregation of RSS feeds from 500 websites. Of these 500 RSS feeds, I need the 15 most recent articles that are over 250 words long, one article per website RSS feed allowed per execution (variable) and only one article per website per day (variable). Each RSS feed will have a predefined thumbnail. (right now my script pulls an image from within the articles but this needs to change to a predefined thumbnail) - I would like the RSS feed and pre defined thumbnail to live in a mySQL db. Your script will run via cron to produce a static file just like this - [url removed, login to view]
I need to be able to change the following variable at will.
- word count (pre set 250) - this needs to be a unique variable per website - store in mysql db
- thumbnail - mysql db
- RSS feed - mysql db
- number of articles outputted to static file (pre set 15) - defined in script
- number of articles allowed per website per day (pre set 2) - this needs to be a unique variable per website - store in mysql db
- number of articles allowed per website per execution (pre set 1) (execution happens very 30 minutes) - store variable in db
Most recent articles from feed are used, so we have fresh content.
- Scalable to 500 + RSS feeds
- Needs to run on small VM Sever - 1gb ram - 2.8 processor - LAMP
- All dependent scripts must live in same folder - no calls to scripts outside of the server - all files in one folder (with sub folders is okay) so I can move this script to production server without worrying to much -
What I'll provide:
List of feeds to start with and thumbnails - 30 RSS feeds to test with
Copies of existing scripts that I have now - but they're only for ideas - they need to be much improved upon -
Server for development -
[url removed, login to view] - end result of script - static file
[url removed, login to view] - this is what the aggregated feeds look like within an iframe
[url removed, login to view] - this combines all the feeds that are over 250 words and outputs them into one RSS feed - (I send that to feed burner) - I do this because it was faster - you might could take this step out -
[url removed, login to view] - this script grab the feed from feedburner - adds thumbnail - I have cron run this script and pump the output here [url removed, login to view]
this is iframe I have website use to display the aggregated rss feeds - [url removed, login to view]
13 freelancers are bidding on average $462 for this job
Hello, I have thoroughly read your project description and I can do this for you, please refer to your PMB for more details. Kind Regards, Alexander Varwijk