I need a script that will scrape [url removed, login to view] and save the information in an xml file. Only the United States "Free" section needs to be scraped and I need to ability to specify the US city (e.g. chicago), area (e.g. sox) and neighborhood (neighborhood should be optional since most cities don't offer this; see "sf bayarea", choose "sby", click "free" and notice the neighborhood dropdown).
Here's the list of information that is needed from the scrape:
URL of Post
URL(s) of photos (if available)
Title of Post
"Reply to" Email Address
This script can be coded in Python (preferred) or Ruby
The "Free" section that I refer to is denoted as "zip" in the URLs from Craigslist.
Here's an example URL to a page that I would like to scrape with a neighborhood:
Here's an example URL to a page without a neighborhood: