Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Real time reads


+
Mohit Anchlia 2012-08-04, 21:34
+
Hari Shreedharan 2012-08-04, 21:49
+
Patrick Wendell 2012-08-04, 22:28
Copy link to this message
-
Re: Real time reads
Mohit Anchlia 2012-08-04, 22:37
On Sat, Aug 4, 2012 at 3:28 PM, Patrick Wendell <[EMAIL PROTECTED]> wrote:

> Mohit,
>
> This sounds like something where you would want your web tier to
> directly access HBase through its existing client API.
>
> Do you need functionality not offered there?
Yes that's how I am currently testing but I just thought it would be nice
to use one framework for both read and write.

>
> - Patrick
>
> On Sat, Aug 4, 2012 at 2:49 PM, Hari Shreedharan
> <[EMAIL PROTECTED]> wrote:
> > Mohit,
> >
> > Flume NG does not really have an HBase source. More importantly our
> sources
> > do not actually pull data. It waits for data to be pushed to it, at least
> > that is what all the current sources do. I don't know if it is a good
> idea
> > to have a source proactively pull stuff from a source. But Flume is
> designed
> > to make practically everything pluggable, so you can write your own
> source
> > that does this.
> >
> >
> > Hari
> >
> > --
> > Hari Shreedharan
> >
> > On Saturday, August 4, 2012 at 2:34 PM, Mohit Anchlia wrote:
> >
> > I am prototyping flume ng for real time sink to hbase and hdfs for
> > clickstream. I was wondering if Flume provides something that can read
> from
> > HBase too. That is API request comes to our web server and after we
> receive
> > the request we use flume to retrieve the result from HBase. Is flume ng
> > meant for this type of scenario?
> >
> >
>
+
Hari Shreedharan 2012-08-05, 01:25