I gang

Twitter Streaming API: Create process to consume its data

I would like to setup two processes to consume data from Twitter's Streaming API:

1) Consume all matching tweets and associated username, user profile pic, longitude, latitude, and time created which match a set of keywords. This will use Twitter's Streaming API's "track" method. [url removed, login to view]

2) Consume all data from Twitter's "Spritzer" which is a ~1% random sample of all their tweets.

The processes must be deployed to Amazon EC2.

The data will be loaded into a database which I have a schema for. Currently I am using MySqL, but based on the data size and the speed which it is loaded, I may want to scale up to an S3 database. If that is the case I will need your help deploying this DB on S3 (or comparable resource). The SLA is that the Streaming API data is available in the DBs no more than 10 seconds later.

The processes should be reliable and provide monitoring on data consumption and cpu/memory used in a daily report. If any of the errors (listed here: [url removed, login to view]) are encountered those should also be logged and in some cases an email alert should be triggered.

Ideally the project will be in python code, but I can compromise here.

If the process is completed in python, meeting requirements, and on time, I can bonus $125.

Færdigheder: MySQL, Python, Script Installering, Software Arkitektur, Twitter

Se mere: twitter streaming api, twitter spritzer amazon ec2, twitter streaming api python, consume twitter amazon, python twitter spritzer, twitter data schema, twitter mysql python, python mysql twitter, mysql python twitter, use case amazon, twitter sample data, twitter spritzer mysql, consume twitter streaming api, twitter streaming, twitter spritzer python, twitter schema python, twitter streaming api amazon, python twitter mysql, s3 database, python streaming, profile pic size, amazon db, twitter dev, twitter data, streaming

Om arbejdsgiveren:
( 2 bedømmelser ) Los Angeles, United States

Projekt-ID: #947727

Tildelt til:

jeffhodsdon

I've done this before working for Digg.

$600 USD in 5 dage
(1 bedømmelse)
3.8

5 freelancere byder i gennemsnit $637 for dette job

buraqtech

Check your PMB for details!!!

$685 USD in 10 dage
(30 bedømmelser)
7.0
WSTIBS

we offer quality solution,time base completion with support. ***** Check PMB ***** Best Regard

$750 USD in 10 dage
(14 bedømmelser)
5.9
Ajz

Hi Pls chk pm Ajz

$600 USD in 10 dage
(5 bedømmelser)
3.4
brunojm

done project similar before

$550 USD in 10 dage
(0 bedømmelser)
0.0