I am looking for a guy who can programm the following python crawler:
There is a list with domains in a .txt file. (between 1 and 20)
There shall be a multithread python programmed that sends 2000 requests per second to a domainrobot each day in a certain amount of time. (00:59:20 am to 01:20:00 am)
In case there is one domain in the list => 2000 requests per second on this domain
In case there are 20 domains in the list => 2000 / 20 = 100 requests per second on this domain
For clarification: I have the permission to send these huge amount of requests to the server.
The code is available in SOAP-API and needs to be converted to python though.
PLEASE JUST BID IF YOU CAN COMPLETELY FULFILL THE REQUIREMENTS IN TIME!
13 freelancers are bidding on average $210 for this job
Hello, I have built a lot of domain tools, If you are trying to catch the expired domains, perhaps I can help to build the tool for you. Kind Regards, Joe
Hi, I think I can do the job. I would need to talk with you more in detail to make you a better proposal about the time it will finished and to know the code you have. Thanks.
Hello, I have experience in data scraping/web page crawling with Python. I can do it in 1 day plus one day for fine-tuning and testing. Best Regards, Vassil Verguilov