Annulleret web scraper

I need a quick web scraper that reads a list of domains from a mysql database than crawls those sites saving all html data into another table of the database.

I have two mysql tables

create table websites


domain_name varchar(255),

parse_type int(32),

last_parsed datetime,

domain_id bigint not null auto_increment,

primary key(domain_id)


create table links


domain_id bigint,

FOREIGN KEY (domain_id) REFERENCES websites(domain_id),

url varchar(1024),

last_parsed datetime,

link_html TEXT,

link_id bigint not null auto_increment,

primary key (link_id)


website table stores the domains, and the links table stores all the pages(url's) you crawled from the website

Evner: MySQL, VB.NET, Web Skrabning

Se mere: screen scraping, vb net pull data from website, visual basic retrieve data from website, c# web scraping tutorial, visual basic get text from website, web scraping using visual basic, web scraping library c#, web scraping in using c#, upload vb net web page intranet, send mail microsoft outlook vb net web app, read txt file vb net web app, rdp client vb net web, net web scraper ajax, net web scraper, google maps vb net web, find crystel report vb net web application, convert vb windows application vb net web application, convert vb net web application, convert desktop application vb net web application net, coding creating funcrion vb net web site

Om arbejdsgiveren:
( 0 bedømmelser ) United States

Projekt ID: #15869784

4 freelancere byder i gennemsnit $161 på dette job

$155 USD in 3 dage
(42 bedømmelser)
$155 USD in 10 dage
(28 bedømmelser)

hello. how are you? i am expert of Qt, visual-c++, c#, visual basic, C. i have many years of experience on like these job. i can satisfy every thing what you want in short time. best regard.

$111 USD in 3 dage
(8 bedømmelser)

I can do it! I have done a lot of web bots and scrapers. Here are my past projects: [login to view URL] This project is perfect with me. Hope to work with you. Best Regards

$222 USD in 3 dage
(3 bedømmelser)