Twitter Streaming API: Create process to consume its data

I would like to setup two processes to consume data from Twitter's Streaming API:

1) Consume all matching tweets and associated username, user profile pic, longitude, latitude, and time created which match a set of keywords. This will use Twitter's Streaming API's "track" method. [url removed, login to view]

2) Consume all data from Twitter's "Spritzer" which is a ~1% random sample of all their tweets.

The processes must be deployed to Amazon EC2.

The data will be loaded into a database which I have a schema for. Currently I am using MySqL, but based on the data size and the speed which it is loaded, I may want to scale up to an S3 database. If that is the case I will need your help deploying this DB on S3 (or comparable resource). The SLA is that the Streaming API data is available in the DBs no more than 10 seconds later.

The processes should be reliable and provide monitoring on data consumption and cpu/memory used in a daily report. If any of the errors (listed here: [url removed, login to view]) are encountered those should also be logged and in some cases an email alert should be triggered.

Ideally the project will be in python code, but I can compromise here.

If the process is completed in python, meeting requirements, and on time, I can bonus $125.

Evner: MySQL, Python, Script Installering, Software Arkitektur, Twitter

Se mere: twitter streaming api, twitter spritzer amazon ec2, twitter streaming api python, python twitter streaming api mysql, consume twitter amazon, python twitter spritzer, consume track twitter streaming api, consume twitter streaming api python, twitter data schema, twitter mysql python, python mysql twitter, python mysql database twitter api, mysql python twitter, use case amazon, no profile pic, twitter sample data, twitter streaming api python database, twitter spritzer mysql, consume twitter streaming api, twitter streaming, twitter spritzer python, twitter streaming api 125 sample, project python twitter data mysql, twitter schema python, twitter streaming api amazon

Om arbejdsgiveren:
( 2 bedømmelser ) Los Angeles, United States

Projekt ID: #947727

Tildelt til:


I've done this before working for Digg.

$600 USD in 5 dage
(1 bedømmelse)

5 freelancere byder i gennemsnit $637 på dette job


Check your PMB for details!!!

$685 USD in 10 dage
(30 bedømmelser)

we offer quality solution,time base completion with support. ***** Check PMB ***** Best Regard

$750 USD in 10 dage
(14 bedømmelser)

Hi Pls chk pm Ajz

$600 USD in 10 dage
(5 bedømmelser)

done project similar before

$550 USD in 10 dage
(0 bedømmelser)