I gang

Web Crawler

Proje Açıklaması:

Hello there,

I have a java project which I want to develop for my report. The project is simple WebCrawler with no interface included. I have managed to finish most of the parts. All I want is optimisation and changing some features of the project. The reason I want to hire a person is, I have no time to optimise this project for the following month.

What I want is;

1st) The database kept on binary text file. I want to change it into MySQL database to make it more efficient and easy to understand.

2nd) Threads. I am using threads but I want them to work more efficient than current version. What threads will be doing is, they will be assigning to one job only ( for example; Start crawling: [url removed, login to view], dont pick any other job like [url removed, login to view], [url removed, login to view] until it finishes the [url removed, login to view] ). The trick point is, when the thread is crawling the links in [url removed, login to view], it should check the links in the another database ( pool DB for links ) whether it exists or not. If it exists, it shouldnt add it into database to prevent extra work and prevent repeated data.

3rd) I want this code to run properly. It doesn't work efficient currently there are some stucking points and other stuff. I have been using several testing tools but some internal code should be corrected.

4th) I am using [url removed, login to view] file, update it with the never version. ( Pretty simple.. )



I will be giving the whole source-code to you. You will have plenty of time to understand and achieve the goals stated above. The codes, other stuff and information will be updated as soon as I hire the professional.

The due date is : May 28

Thanks in advance!

Færdigheder: PHP, Software Arkitektur

Se mere: web proje, web crawler features, job web crawler, java hire testing, features web crawler, develop web crawler java, web crawler tools, hire java professional, webcrawler, proje, java thread, geoip, database crawler, c proje, web data crawler, java project using threads, crawler report, crawling java, java proje, dat mysql, trick version, crawler using java, crawler interface, java web crawling, dat database java

Om arbejdsgiveren:
( 3 bedømmelser ) California, Turkey

Projekt-ID: #5991568

Tildelt til:


A proposal has not yet been provided

$333 USD in 4 dage
(1 bedømmelse)

6 freelancere byder i gennemsnit $423 for dette job


if you need the webcrawler to be converted from java to php/mysql programming then i can help you on this regardingly so let me know asap.

$350 USD in 5 dage
(306 bedømmelser)

do u want this in 10 days with the budget mentioned. ..............................................................

$664 USD in 10 dage
(38 bedømmelser)

A proposal has not yet been provided

$333 USD in 3 dage
(35 bedømmelser)

i am well experienced in threading and mysql , i can do this job well .

$333 USD in 7 dage
(20 bedømmelser)

A proposal has not yet been provided

$526 USD in 8 dage
(4 bedømmelser)

Hi, We gone through with requirement and we have done SIMILAR PROJECT in past contact us for FREE demo. SK Yy P :- sales.sophia.wright iPhone Portfolio https://itunes.apple.com/in/app/six-guns/id Mere

$334 USD in 5 dage
(0 bedømmelser)