build scraper for [url removed, login to view]

This project will require you to use Perl/mechanize to scrape [url removed, login to view], which is an ASP.NET site.

Deliverable is a perl script.

You may use outside libraries like mechanize and your favorite html parser. I use mechanize but you can also use selenium if that works too (though I'd prefer mechanize, which would require you to sift through the javascript functions)

The script should basically continue what I've begun below. It should be able to plug in cities and dates from the home page, submit that form, then be able to extract the dates/times/prices. ( I will add code to insert that data into a database)


Here's what I have so far... it doesn't work at all. I think the big thing is knowing the form elements, but there is also what appears to be a session id or something that changes each time you load the page.


use WWW::Mechanize;

use HTTP::Cookies;

use LWP::Simple;

my $url = '[url removed, login to view]';

$outpath = 'C:\Documents and Settings\My Documents';

my $mech = WWW::Mechanize->new();




form_name => 'ctl01',

fields => {

'SearchAndBuy1_txtPassengers' => 1,

'SearchAndBuy1_ddlLeavingFrom' => 37,

'SearchAndBuy1_ddlTravellingTo' => 41,

'SearchAndBuy1_txtOutboundDate' => 4305



sleep 1;

$html = $mech->content();

$out = ">" . $outpath . '\\' . '[url removed, login to view]';

open(OUT, $out);

print OUT $html;


print "done";

Evner: ASP, Perl, Web Skrabning

Se mere: megabus scrape, www work at home com, www at&t.com, work at home like us, work at home database, com works, at&t com, $5 com, megabus project, megabus script, megabus perl, perl asp scrape, javascript print time, ve-com, the big think, Sleep, selenium\, selenium javascript, perl parser, mech, html parser, home build, database build, d bin, build html

Om arbejdsgiveren:
( 6 bedømmelser ) New York, United States

Projekt ID: #1000549

Tildelt til:


HI ,I am data scraping expert .Please check PM.

$100 USD in 15 dage
(25 bedømmelser)

9 freelancers are bidding on average $133 for this job


We can help in your project, please check PMB and our ratings/reviews to get idea of our experience.

$100 USD in 3 dage
(47 bedømmelser)

I am an expert in perl and I can deliver the code with perl

$100 USD in 4 dage
(46 bedømmelser)

I can do this job for you. See PM for details.

$100 USD in 3 dage
(165 bedømmelser)

Hi, please check your PMB. Thanks.

$200 USD in 3 dage
(26 bedømmelser)

Hi jeffrono, please see our offer in the PM. Thanks.

$200 USD in 5 dage
(9 bedømmelser)

Hello, glad to help you!

$150 USD på 1 dag
(4 bedømmelser)

please see pm

$100 USD in 0 dage
(0 bedømmelser)

Please check PMB

$150 USD in 7 dage
(0 bedømmelser)