Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - HTable and streaming


Copy link to this message
-
Re: HTable and streaming
Azuryy Yu 2013-06-04, 04:31
This should be a big patch, HBase need to provide streaming access, such as
HTableInputStream, HTableOutputStream etc.
On Tue, Jun 4, 2013 at 12:12 PM, Asaf Mesika <[EMAIL PROTECTED]> wrote:

> I guess one can hack opening a socket from a Coprocessor Endpoint and push
> its scanned data, thus achieving a stream.
>
>
> On Sun, Jun 2, 2013 at 12:42 AM, Stack <[EMAIL PROTECTED]> wrote:
>
> > Yeah, no streaming API in our current client (nor does our thrift client
> > give you a streaming API).
> > St.Ack
> >
> >
> > On Sat, Jun 1, 2013 at 8:21 AM, Simon Majou <[EMAIL PROTECTED]> wrote:
> >
> > > No I don't want to scan a table, I want a stream of one result. In case
> > for
> > > example of big records.
> > >
> > > With thrift it is up to the client to deal with the response, so in
> > theory
> > > you can build a client which returns streams.
> > >
> > > But when I look at the current implementation of thrift for node for
> > > instance (https://github.com/apache/thrift/tree/trunk/lib/nodejs), it
> > > sends
> > > back only full formed results (as the Java client).
> > >
> > >
> > > Simon
> > >
> > >
> > > On Sat, Jun 1, 2013 at 5:14 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
> > >
> > > > I assume you want to scan the table:
> > > >
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HTable.html#getScanner(byte[])
> > > >
> > > > Can you point out which thrift client methods provide streaming
> > > capability
> > > > ?
> > > >
> > > > Thanks
> > > >
> > > > On Sat, Jun 1, 2013 at 8:09 AM, Simon Majou <[EMAIL PROTECTED]> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I don't see any methods returning streams in the Java client
> HTable :
> > > > >
> > > >
> > >
> >
> http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/client/HTable.html
> > > > >
> > > > > That means we need to use the thrift client to get streams ?
> > > > >
> > > > > Simon
> > > > >
> > > >
> > >
> >
>