I have a java project which I want to develop for my report. The project is simple WebCrawler with no interface included. I have managed to finish most of the parts. All I want is optimisation and changing some features of the project. The reason I want to hire a person is, I have no time to optimise this project for the following month.
What I want is;
1st) The database kept on binary text file. I want to change it into MySQL database to make it more efficient and easy to understand.
2nd) Threads. I am using threads but I want them to work more efficient than current version. What threads will be doing is, they will be assigning to one job only ( for example; Start crawling: [url removed, login to view], dont pick any other job like [url removed, login to view], [url removed, login to view] until it finishes the [url removed, login to view] ). The trick point is, when the thread is crawling the links in [url removed, login to view], it should check the links in the another database ( pool DB for links ) whether it exists or not. If it exists, it shouldnt add it into database to prevent extra work and prevent repeated data.
3rd) I want this code to run properly. It doesn't work efficient currently there are some stucking points and other stuff. I have been using several testing tools but some internal code should be corrected.
4th) I am using [url removed, login to view] file, update it with the never version. ( Pretty simple.. )
I will be giving the whole source-code to you. You will have plenty of time to understand and achieve the goals stated above. The codes, other stuff and information will be updated as soon as I hire the professional.
The due date is : May 28
Thanks in advance!