I gang

178873 Spider for free domain names

I'm looking for a spider or crawler software that will automatically scan webpages and follow links. The software should extract all domainnames (.com/net/org/info/de/ch/at etc. no subdomains) and email adresses from the webpages and write them to a dailylogfile (one logfile for domainnames and one for emails). After the crawl a indexer should cleanup the textfile and display only unique datasets.

the crawler should run each night and should avoid visiting the same pages each day. mailny i'm interested in Domainnames from europe, so it would be a good idea to limit the crwaler to european IP adresses.

I found a software called phpcrawl and I want to have a modification to it ([url removed, login to view])

The software should run on a LAMPP System.

Thanks for a offer

Evner: Lidt af Hvert, Perl, PHP

Se mere: write names, free write, com domain offer, spider, names email, ip to domain, european domain, email crawler, domain names, domain email, net crawl, write free, crawl net, email indexer, email extract perl, php email extract crawl, cleanup extract, email extract software, php crawler email, cleanup names

Om arbejdsgiveren:
( 0 bedømmelser ) Karlsruhe, Germany

Projekt ID: #1925078