Tweets of Energy

Offentlig Præciserings Opslagstavle

• 

  csabikuc

  • 10 år siden

  please send me more details

  • 10 år siden
• 
  Konkurrenceafholder

  • 10 år siden

  i want the streamin in with using storm project, i want system to be scaleable... https://github.com/nathanmarz/storm/wiki

  • 10 år siden
  1. 

     twistedhardware

     • 10 år siden

     I'm using Celery for Queue Management and RabbitMQ as a broker. I have your stream handled by 10 workers to ensure real time operation. the Celery tasks are pretty stable under good shower of tweets. With the current setup I can handle up to 350 tweets per second per machine. This setup is very scalable has been put to a lot of stressful tasks.
     
     I took a look a storm and it quite good but I don't think I can rewrite a major part of my system to utilize a different another queuing system. I can keep the stream for another 9 days and work on a specialized dashboard interface with some stats and chats and google map. I can show some interesting results like most shared tweets for different places and have all of that live from the stream.

     • 10 år siden
  2. 

     twistedhardware

     • 10 år siden

     I'll need to know if is it OK to continue with Celery instead of Storm.

     • 10 år siden
• 

  twistedhardware

  • 10 år siden

  I have a system that does that. I started streaming the word energy and it is being stored into a database. I have a live dashboard for you to monitor what is trending in your stream.
  
  I'll work on a google map interface that shows live data. That shouldn't take too long.

  • 10 år siden
• 

  yogeshsharma89

  • 10 år siden

  This is quite interesting project. Can I have your skype so we can discuss bit more ? Then I will develop and submit my entry.

  • 10 år siden