Scrap Site for Meta Data

Project Description:

Crawl these links every X # number of minutes. When Content Changes, Scrape data. And Save it to a SQL Database, That I will provide you.

There are 8 links, all using the same format. Its the same Formate for all Pages. So Nothing really changes as far as scraping btween pages, but each page needs to be scrapped. I will supply you with the 8 page URLs. You can see the layout in the Attached Image.

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

Content Gets updated at a slow rate. About 15-20 links a day, on each Page, but need to check to see if the page changed every 15 min, or so (configurable)

You also have to update values, that have changed since the last scrape. For example Comment Count (Score)

Title - Title of the Article

Site - Have to parse this out of the URL

URL - Have to Parse this, the URL format is [login to view URL]://[login to view URL], you need to take the value from [login to view URL]

Meta - Is the Category that is assigned


No Duplicates


Evner: .NET, C# Programmering

Se mere: parse programming, min its com, meta programming, btween, sql duplicates, scrape sql database, scrape for links, scrap image, meta-description, meta data, crawl data, Cat6, net crawl, net data scraping, crawl net, net scrape data, scrapped article, net number format, scrape data sql, parse sql data

Om arbejdsgiveren:
( 94 bedømmelser ) West Hempstead, United States

Projekt ID: #5749931

Tildelt til:


I am experienced on C#, .Net, C++, SQL, MySql and web scraping/bot programming, I check your project's details and attachment very carefully, I can complete your work 100% perfectly and I can give you a perfect desktop Flere

$111 USD in 7 dage
(17 bedømmelser)

6 freelancere byder i gennemsnit $152 timen for dette job


expert C# scraper at your service... Just check my portfolio, and I am sure that you will award me immediatell..

$105 USD in 3 dage
(13 bedømmelser)

Hi, I have scraped [login to view URL], [login to view URL], [login to view URL] in .NET and stored the data in MS SQL. I would like to be invited for this project. regards, Nittile

$206 USD in 5 dage
(9 bedømmelser)

Hi Kevin, I am interested in your project & I wrote small C# .NET 4.5 demo app. It parses geek section of fark site, saves all info in a [login to view URL] file (semicolons separated values) and exits automatically. Final v Flere

$150 USD in 4 dage
(8 bedømmelser)

A proposal has not yet been provided

$150 USD in 3 dage
(1 bedømmelse)

Hello Sir I am an expert web developer with an experience of over 5 years and a university bachelors degree in computer science major. with web development i am also doing web scraping work very efficently . i have d Flere

$188 USD in 3 dage
(0 bedømmelser)