I'm looking for a program to be created for MySpace.com.
This tool will analyze the 100 million MySpace profiles and datascrape how many friends
each ID has, then create a top 100 or top 1000 listing of people with the most friends on
People on MySpace display their friends on their profiles.. like "so and so has 34234243 friends".
That kind of data needs to be scraped along with the profile ID.
What needs to be done is to extract that information specifically from all 100,000,000+ profiles
through a software program.
So the program would start from the beginning and pick up through each profile like ID: 34324 ...
Based on having talked to other programmers, this would require having to data scrape this profile
by profile. I'm not interested in scraping images or sound or anything like that. Just an ID and
the amount of friends the user has. So i guess the application can start from friend id=1 and work
its way up. It should be able to pause or resume or be able to start from a selected friend ID.
So suppose if i stopped at 400, then tomorrow i can input "401" and it continues on from there.
The data needs to be saved whether it's SQL or the computer, whichever is the most efficient.
Even if there are profiles that are set to "PRIVATE" or are "DELETED" it doesn't matter. The program
should sksip them.
SAMPLE OF HOW IT SHOULD LOOK:
User ID: 2
User ID: 5
User ID: 8
Username: The Regular
User ID: 10
User ID: 11
Username: [url removed, login to view]
User ID: 13
User ID: 14
Username: alfie numeric
User ID: 22
If you're competant and can deliver it within less than a 5 day period, then lets start rolling.
PLEASE DO NOT POST A BID IF YOU DON'T THINKK YOU CAN DO THIS. I've had enough incompetant programmers trying to take the job already.