Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Real time reads


+
Mohit Anchlia 2012-08-04, 21:34
+
Hari Shreedharan 2012-08-04, 21:49
+
Patrick Wendell 2012-08-04, 22:28
Copy link to this message
-
Re: Real time reads
On Sat, Aug 4, 2012 at 3:28 PM, Patrick Wendell <[EMAIL PROTECTED]> wrote:

> Mohit,
>
> This sounds like something where you would want your web tier to
> directly access HBase through its existing client API.
>
> Do you need functionality not offered there?
Yes that's how I am currently testing but I just thought it would be nice
to use one framework for both read and write.

>
> - Patrick
>
> On Sat, Aug 4, 2012 at 2:49 PM, Hari Shreedharan
> <[EMAIL PROTECTED]> wrote:
> > Mohit,
> >
> > Flume NG does not really have an HBase source. More importantly our
> sources
> > do not actually pull data. It waits for data to be pushed to it, at least
> > that is what all the current sources do. I don't know if it is a good
> idea
> > to have a source proactively pull stuff from a source. But Flume is
> designed
> > to make practically everything pluggable, so you can write your own
> source
> > that does this.
> >
> >
> > Hari
> >
> > --
> > Hari Shreedharan
> >
> > On Saturday, August 4, 2012 at 2:34 PM, Mohit Anchlia wrote:
> >
> > I am prototyping flume ng for real time sink to hbase and hdfs for
> > clickstream. I was wondering if Flume provides something that can read
> from
> > HBase too. That is API request comes to our web server and after we
> receive
> > the request we use flume to retrieve the result from HBase. Is flume ng
> > meant for this type of scenario?
> >
> >
>
+
Hari Shreedharan 2012-08-05, 01:25
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB