Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Real time reads


+
Mohit Anchlia 2012-08-04, 21:34
+
Hari Shreedharan 2012-08-04, 21:49
Copy link to this message
-
Re: Real time reads
Patrick Wendell 2012-08-04, 22:28
Mohit,

This sounds like something where you would want your web tier to
directly access HBase through its existing client API.

Do you need functionality not offered there?

- Patrick

On Sat, Aug 4, 2012 at 2:49 PM, Hari Shreedharan
<[EMAIL PROTECTED]> wrote:
> Mohit,
>
> Flume NG does not really have an HBase source. More importantly our sources
> do not actually pull data. It waits for data to be pushed to it, at least
> that is what all the current sources do. I don't know if it is a good idea
> to have a source proactively pull stuff from a source. But Flume is designed
> to make practically everything pluggable, so you can write your own source
> that does this.
>
>
> Hari
>
> --
> Hari Shreedharan
>
> On Saturday, August 4, 2012 at 2:34 PM, Mohit Anchlia wrote:
>
> I am prototyping flume ng for real time sink to hbase and hdfs for
> clickstream. I was wondering if Flume provides something that can read from
> HBase too. That is API request comes to our web server and after we receive
> the request we use flume to retrieve the result from HBase. Is flume ng
> meant for this type of scenario?
>
>
+
Mohit Anchlia 2012-08-04, 22:37
+
Hari Shreedharan 2012-08-05, 01:25