I am looking for a guy who can programm the following python crawler:
There is a list with domains in a .txt file. (between 1 and 20)
There shall be a multithread python programmed that sends 2000 requests per second to a domainrobot each day in a certain amount of time. (00:59:20 am to 01:20:00 am)
In case there is one domain in the list => 2000 requests per second on this domain
In case there are 20 domains in the list => 2000 / 20 = 100 requests per second on this domain
For clarification: I have the permission to send these huge amount of requests to the server.
The code is available in SOAP-API and needs to be converted to python though.
PLEASE JUST BID IF YOU CAN COMPLETELY FULFILL THE REQUIREMENTS IN TIME!
12 freelancere byder i gennemsnit $206 på dette job
Hello, I have built a lot of domain tools, If you are trying to catch the expired domains, perhaps I can help to build the tool for you. Kind Regards, Joe
Hello, I have experience in data scraping/web page crawling with Python. I can do it in 1 day plus one day for fine-tuning and testing. Best Regards, Vassil Verguilov