Annulleret

CURL bot class redesign needed

I need a better/working CURL class written in PHP. The most important feature of this class should be the use of HTTP proxies and the error handling that comes with the use of proxy servers. Currently I'm using the following 2 classes along with the attached proxies list to do my crawling. Unfortunately this bot is not that smart.

I need you to redesign this bot to recover from proxy errors without breaking the current bot interface. Basically it should try a different proxy in the list when a error occurs as well as detect errors in a better way. The bot class in it's current state is very unreliable as it doesn't pick up transfer errors. For instance when I do a GET of a certain page it returns and empty response with no errors in the "curl_errno($this->ch)" method.

My budget is small, I can get answers to my problem in forums but frankly don't have the time to research it.

Færdigheder: PHP

Se mere: curl crawl bot, redesign php, php bot , ch, bot t, need curl, php curl error empty, bot handling, breaking, proxy list bot, small curl, use proxy list, working proxy servers, recover page, better redesign, bot time, pick list, proxy page, crawling php, working proxies bot, redesign page, bot proxy php, detect proxy php, proxy detect php, proxy detect

Om arbejdsgiveren:
( 30 bedømmelser ) Ballito, South Africa

Projekt-ID: #262858

2 freelancere byder i gennemsnit $50 for dette job

neanton

I can do that

$70 USD på 1 dag
(84 bedømmelser)
5.9
GFalcon

I've viewed the attached scripts and found what has to be changed there to add the proxy support you need. It's not much - I can do it in ~4 hours.

$30 USD på 1 dag
(3 bedømmelser)
1.9