Code I/O

A topnotch WordPress.com site

5 Minutes on Java : A quick tutorial on writing scalable applications with Yahoo’s s4.io scalability framework

Leave a comment

BigData needs BigProcessing 🙂 … Hadoop solves one problem, the approach of distributed processing.  One of the key benefits is that, the information can be broken down into smaller chunks and processed independently.  However, the information must be first stored into HDFS for processing, more suitable for batch-processing, more over data-movement is critical for processing by Hadoop.

In a real-time world, where one needs to processing incoming events (stream) instantaneously, then one will require a different framework.  Yahoo S4 is an example of such an alternative framework for event processing.

Refer to the evolving documentation on S4 : http://docs.s4.io/manual/overview.html

 

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s