Web Crawler

Proje Açıklaması:

Hello there,

I have a java project which I want to develop for my report. The project is simple WebCrawler with no interface included. I have managed to finish most of the parts. All I want is optimisation and changing some features of the project. The reason I want to hire a person is, I have no time to optimise this project for the following month.

What I want is;

1st) The database kept on binary text file. I want to change it into MySQL database to make it more efficient and easy to understand.

2nd) Threads. I am using threads but I want them to work more efficient than current version. What threads will be doing is, they will be assigning to one job only ( for example; Start crawling: [url removed, login to view], dont pick any other job like [url removed, login to view], [url removed, login to view] until it finishes the [url removed, login to view] ). The trick point is, when the thread is crawling the links in [url removed, login to view], it should check the links in the another database ( pool DB for links ) whether it exists or not. If it exists, it shouldnt add it into database to prevent extra work and prevent repeated data.

3rd) I want this code to run properly. It doesn't work efficient currently there are some stucking points and other stuff. I have been using several testing tools but some internal code should be corrected.

4th) I am using [url removed, login to view] file, update it with the never version. ( Pretty simple.. )



I will be giving the whole source-code to you. You will have plenty of time to understand and achieve the goals stated above. The codes, other stuff and information will be updated as soon as I hire the professional.

The due date is : May 28

Thanks in advance!

Færdigheder: PHP, Software Arkitektur

Se mere: web proje, web crawler features, job web crawler, java hire testing, features of a web crawler, develop a web crawler in java, what is web crawling, what is a crawler, web crawler tools, hire java professional, Webcrawler, proje, java thread, geoip, database crawler, crawling of data, c# proje, c proje, binary file text file, web data crawler, java project using threads, crawler report, crawling java, java proje, add text file project java

Om arbejdsgiveren:
( 3 bedømmelser ) California, Turkey

Projekt-ID: #5991568

Tildelt til:


A proposal has not yet been provided

$333 USD in 4 dage
(1 bedømmelse)

6 freelancers are bidding on average $423 for this job


if you need the webcrawler to be converted from java to php/mysql programming then i can help you on this regardingly so let me know asap.

$350 USD in 5 dage
(306 bedømmelser)

do u want this in 10 days with the budget mentioned. ..............................................................

$664 USD in 10 dage
(38 bedømmelser)

A proposal has not yet been provided

$333 USD in 3 dage
(35 bedømmelser)

i am well experienced in threading and mysql , i can do this job well .

$333 USD in 7 dage
(20 bedømmelser)

A proposal has not yet been provided

$526 USD in 8 dage
(4 bedømmelser)

Hi, We gone through with requirement and we have done SIMILAR PROJECT in past contact us for FREE demo. SK Yy P :- [url removed, login to view] iPhone Portfolio [url removed, login to view] Mere

$334 USD in 5 dage
(0 bedømmelser)