Advanced Web Crawler

$750-1500 USD

Annulleret

Slået op

over 11 år siden

$750-1500 USD

Betales ved levering

I am looking for an Advanced Web crawler built in Java. This crawler would at most be scanning 2 urls on a domain: A) Get a url from my database(ex: [login to view URL]) and scan the domain and the source of the domain for specific rules I will set such as: 1) Wordpress, Joomla, Drupal code signatures. - If yes, return Yes to the database. 2) Check to see if there is a link that is labeled "blog" or "contact us". IF either of these pages are found - Return the URL to the database for the correct one, IF yes for contact us THEN scan the page that was found for an email address. 4) Scan the site for a specific list of keywords, including 404 not found, and domain for sale. 3) Update the database with timestamp stating the site has been crawled. These are currently the 2 rules we need, but we will want the code to be written to easily add/modify these rules in the future. The most important process of this is Speed. Please place how many urls you think can be crawled in one day, as this will greatly influence who does the job.

Java

MySQL

PHP

Projekt-ID: 4134206

Om projektet

10 forslag

Projekt på afstand

Aktiv 11 år siden

Leder du efter muligheder for at tjene penge?

Emailadresse

Fordele ved budafgivning på Freelancer

Fastsæt dit budget og din tidsramme

Bliv betalt for dit arbejde

Oprids dit forslag

Det er gratis at skrive sig op og byde på jobs

10 freelancere byder i gennemsnit $1.084 USD på dette job

@creatorul

Professional solutions

$1.500 USD på 12 dage

5,0

(81 anmeldelser)

7,0

@javaphpsql

I am a Java developer with more than 10 years of experience in designing the Java multi-threaded applications and with more than 3 years experience in creating web harvesting applications. Please, check PM.

$799 USD på 12 dage

4,9

(6 anmeldelser)

4,7

@DenialWang

see pm please, thanks.

$750 USD på 4 dage

4,9

(6 anmeldelser)

4,3

@ciphe

Please see PMB.

$2.500 USD på 20 dage

4,8

(5 anmeldelser)

4,4

@saobiensoft

I'm interested in your job. Please check PMB for more details.

$750 USD på 10 dage

4,5

(6 anmeldelser)

3,5

@JavaGuruLV

Hi, I was finished similar project on this site. Target of this project was get urls from specified list, then crawl domain, parse results, remove html tags from page, count and store retrieved words to database. I used very fast crawler. It can simultaneously crawl many pages. My crawler has several important parameters, using it you can configure crawler inside your environment for best performance.

$750 USD på 5 dage

4,8

(4 anmeldelser)

2,8

@prologik

Hello. I'm a software engineer, and also a Senior Developer and Software Architect. Please see my private message for justification of my bid. Thanks in advance and good luck with your project. Best Regards! Esteban Esteban

$1.100 USD på 12 dage

5,0

(3 anmeldelser)

2,6

@paruikrishnendu

We are new on Freelancer, but since long time we are working internationally. We are confident that we can help you to fulfill your requirements. We'll give our best efforts to your project. We've a skilled team of developers and have worked on various requirements of complex projects. Request you to open private message board for genuine thread of communication and to get the ball rolling.

$750 USD på 15 dage

0,0

(1 bedømmelse)

0,0

@getveltrod

Hi, Veltrod Software services is a global software consulting company specialized in providing Mobile applications, Social media frameworks and eCommerce solutions. Leveraging best-in-class people, processes, and technologies, Veltrod provides high-quality software development and BPO services to independent software vendors and enterprises. We are specialized in developing Mobile applications, Search Engine optimizations, Social Network frameworks, Software Testing and ERP applications. We are pleased to take care of this project, if it is offered to us. We assure that we will work towards 100% client satisfaction. Thanks Vignesh

$1.000 USD på 28 dage