Annulleret

CURL bot class redesign needed

I need a better/working CURL class written in PHP. The most important feature of this class should be the use of HTTP proxies and the error handling that comes with the use of proxy servers. Currently I'm using the following 2 classes along with the attached proxies list to do my crawling. Unfortunately this bot is not that smart.

I need you to redesign this bot to recover from proxy errors without breaking the current bot interface. Basically it should try a different proxy in the list when a error occurs as well as detect errors in a better way. The bot class in it's current state is very unreliable as it doesn't pick up transfer errors. For instance when I do a GET of a certain page it returns and empty response with no errors in the "curl_errno($this->ch)" method.

My budget is small, I can get answers to my problem in forums but frankly don't have the time to research it.

Færdigheder: PHP

Se mere: php curl class proxy, curl class, curl crawl bot, redesign php, php bot , ch, bot, bot t, time class, need curl, detect php, php curl http proxy, php curl error empty, php curl proxy http, bot handling, using class, breaking, proxy list bot, php curl class, small curl, use proxy list, working proxy servers, recover page, need class, better redesign

Om arbejdsgiveren:
( 30 bedømmelser ) Ballito, South Africa

Projekt-ID: #262858

2 freelancere byder i gennemsnit $50 for dette job

neanton

I can do that

$70 USD på 1 dag
(84 bedømmelser)
5.9
GFalcon

I've viewed the attached scripts and found what has to be changed there to add the proxy support you need. It's not much - I can do it in ~4 hours.

$30 USD på 1 dag
(3 bedømmelser)
1.9