Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Real time reads

Mohit Anchlia 2012-08-04, 21:34
Hari Shreedharan 2012-08-04, 21:49
Copy link to this message
Re: Real time reads

This sounds like something where you would want your web tier to
directly access HBase through its existing client API.

Do you need functionality not offered there?

- Patrick

On Sat, Aug 4, 2012 at 2:49 PM, Hari Shreedharan
> Mohit,
> Flume NG does not really have an HBase source. More importantly our sources
> do not actually pull data. It waits for data to be pushed to it, at least
> that is what all the current sources do. I don't know if it is a good idea
> to have a source proactively pull stuff from a source. But Flume is designed
> to make practically everything pluggable, so you can write your own source
> that does this.
> Hari
> --
> Hari Shreedharan
> On Saturday, August 4, 2012 at 2:34 PM, Mohit Anchlia wrote:
> I am prototyping flume ng for real time sink to hbase and hdfs for
> clickstream. I was wondering if Flume provides something that can read from
> HBase too. That is API request comes to our web server and after we receive
> the request we use flume to retrieve the result from HBase. Is flume ng
> meant for this type of scenario?
Mohit Anchlia 2012-08-04, 22:37
Hari Shreedharan 2012-08-05, 01:25