we worked together in the past for scraping and I really appreciated your work. I created a new project and wanted you to check it out to see if you had any interest. It's called "simple scraping done in ruby". It is a very simple scraping project but I am expecting some good code as I wish to reuse it often.
Here is what I wrote there:
Here is a link example: [url removed, login to view];idqfix=1&idtt=1&idtypebien=1,2&org=engine&BCLANNpg=1
For this project, you'll need to write a scraper with Ruby (we can talk gems, but mechanize and nokogiri would be perfect) to scrape all the entries for the many pages available starting from some given urls. The output will be a single table (csv for example), that will have to be clean (some regexp will have to be applied to clean phone numbers for example). The columns are yet to be determined but the data will be easily accessible in the html. (probably ~10 regexp to be written)
The code will need to be well-written and commented. Some simple spec coverage required for future maintainability.
There will be follow-up projects, e.g being able to run the scraper daily for updates.