I need a script that will extract data from a classified ads website.
The script must be able to do this slowly and through a http proxy as not to set off red flags from the site owner.
In order to be able to access the data on this site, you must be logged into their system for the data to be visible.
This script will have two sides to it, Data Collection and Email and should be fully automated so that all the end user of the script has to do is set it up, turn it on and leave it alone.
The script should also have a stats option where the number of emails sent, data collected for each day, week, month is easily viewed.
They would like is script to be able to extract the following data:
Name of Poster
Location of Poster
Time and Date of Post
Subject line of post
Category Posted in
Price ( Where no price is listed 0.00 should be added into Database )
Then they would want this script to be able to email each poster ( Only once unless the script is reset to allow to send a second time to any email address )
It should have an area where they can add blacklisted email addresses that are never allowed to be emailed to.
And be able to use any of the above data in the email as well as be able to send a set amount of email per day that can be sent out to groups based on category, location of poster or time/date of post.
They should be able to make an email template and the system email a set number of these records daily and they should be able to send based on the date of their post, location of their post, or category.
This must be able to send so that it does not look like spam, and must be able to collect so that it is not blocked for data mining.
The site in question does not use image security or anything to block or prevent the data from being mined or anyone from logging in, the only thing is that it needs to be logged in and have the cookie present in order for the site to output the data they are seeking.
This should be able to be run on a time of day system that after the initial data extraction that it would visit the new posts page every 30 minutes and pull that data and amend it to the database.
This should all be neat and tidy in a user interface that is user friendly as these guys are by no means computer savy.
Anyone who would like to check out the classified site in question before bidding should message me on the private message board system and I will send you a link to the site.
No money up front, no money until the script is written and working on the client's server.
Scriptlance Escrow is no problem … will place money in escrow before you start the project.
Do not post a timeframe to complete the project that you can not keep … this makes me look like an idiot with my clients and I will rate you accordingly based on your keeping you word on timeline and quality.
So do not make promises you can not keep just to get the work.