If you conduct any search on Twitter, you'll see you get a series of results of tweets. I want to be able to scrape all the usernames from these search results. The only thing I want to collect is the usernames - that's it, nothing more.
Some search results will have a few hundred results, and othes will have a few thousand, depending on the day. The search results vary from day to day, and even from hour to hour.
There will be various search strings to be used in the searches but all of them are easily available through Twitter. I have a tool already that can do this work, but it's not multi-threaded so I have to run each search one-by-one, which takes too much time every day.
I have over a hundred different search queries needed to run anywhere between 1-3 times each day. I'd like to have it run multi-threaded so I can lauch all the search queries all at once and collect the search results within a few minutes. In order to do this the script cannot use Twitter API as it will run into rate limits. Also, the script will need to be able to use proxies in order to run the threaded searches simultaneously without getting limited, or the IP temporarily blocked.
The technical part is up to you! It doesn't matter to me what platform, or programming language is used, so whatever will get the job done is fine with me.
I'm ready to start now and online to answer questions.
7 freelancere byder i gennemsnit $302 på dette job
Sir, I will do this task using Api or curl. I have already done this scraper working in Cake Php , Symfony and Yii. You just explain your task.i am fresher on freelancer. Thanks