Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Flume HbaseSink ZK woes


Copy link to this message
-
Re: Flume HbaseSink ZK woes
Iain,

Thanks for investigating. It looks like ZK 3.4.4 has the fix. So you should just be able to remove the older ZK version and drop the new one in.

Thanks,
Hari

--
Hari Shreedharan
On Monday, October 8, 2012 at 5:03 PM, iain wright wrote:

> - built latest 3.4 branch of zookeeper that included a commit/fix for the bug above: http://svn.apache.org/viewvc/zookeeper/branches/branch-3.4/
> - ran 'ant' to build it
> - copied the new zookeeper jar to flume/lib directory
> - renamed the old one to flume-blah.old so the new one would be picked up
>
> and we are now writing to hbase!
>
> Thanks,
>
> --
> Iain Wright
>
>
 (http://www.labctsi.org/)> This email message is confidential, intended only for the recipient(s) named above and may contain information that is privileged, exempt from disclosure under applicable law. If you are not the intended recipient, do not disclose or disseminate the message to anyone except the intended recipient. If you have received this message in error, or are not the named recipient(s), please immediately notify the sender by return email, and delete all copies of this message.
>
>
> On Mon, Oct 8, 2012 at 4:23 PM, iain wright <[EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])> wrote:
> > Still no hits from the hbase guys,
> >
> > I think we may getting bit by this:https://issues.apache.org/jira/browse/ZOOKEEPER-1437
> >
> > Based on a ton of these in the debug console output:
> >
> > 2012-10-08 16:19:56,863 (lifecycleSupervisor-1-1-SendThread(hbasemaster0.hadoop.telescope.tv:2181 (http://hbasemaster0.hadoop.telescope.tv:2181))) [DEBUG - org.apache.zookeeper.ClientCnxnSocketNIO.findSendablePack
> > et(ClientCnxnSocketNIO.java:164)] deferring non-priming packet: clientPath:null serverPath:null finished:false header:: 0,3  replyHeader:: 0,0,0  request:: '/hbase/ma
> > ster,T  response::  until SASL authentication completes.                                                                                                              
> > 2012-10-08 16:19:56,865 (lifecycleSupervisor-1-1-SendThread(hbasemaster0.hadoop.telescope.tv:2181 (http://hbasemaster0.hadoop.telescope.tv:2181))) [DEBUG - org.apache.zookeeper.ClientCnxnSocketNIO.findSendablePack
> > et(ClientCnxnSocketNIO.java:164)] deferring non-priming packet: clientPath:null serverPath:null finished:false header:: 0,3  replyHeader:: 0,0,0  request:: '/hbase/ma
> > ster,T  response::  until SASL authentication completes.                                                                                                              
> > 2012-10-08 16:19:56,866 (lifecycleSupervisor-1-1-SendThread(hbasemaster0.hadoop.telescope.tv:2181 (http://hbasemaster0.hadoop.telescope.tv:2181))) [DEBUG - org.apache.zookeeper.ClientCnxnSocketNIO.findSendablePack
> > et(ClientCnxnSocketNIO.java:164)] deferring non-priming packet: clientPath:null serverPath:null finished:false header:: -2,11  replyHeader:: null request:: null respo
> > nse:: nulluntil SASL authentication completes.                              
> >
> > It looks like a patch is committed, but No idea how to upgrade zookeeper in the flume hbase client (or does it use a client from the hbase_home?) -- if that's even the root cause here: http://svn.apache.org/viewvc?view=revision&revision=1382555
> >
> >
> > Cheers,
> > --
> > Iain Wright
> >
> >
 (http://www.labctsi.org/)> > This email message is confidential, intended only for the recipient(s) named above and may contain information that is privileged, exempt from disclosure under applicable law. If you are not the intended recipient, do not disclose or disseminate the message to anyone except the intended recipient. If you have received this message in error, or are not the named recipient(s), please immediately notify the sender by return email, and delete all copies of this message.
> >
> >
> > On Mon, Oct 8, 2012 at 2:14 PM, iain wright <[EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])> wrote:
> > > Hi Hari,
> > >
> > > Getting similar (but seemingly more serious/frequent) results with the ASync Sink, I'll hit the hbase list as well. Thank you
 (http://www.labctsi.org/)> > >
 (http://www.labctsi.org/)> > > > > This email message is confidential, intended only for the recipient(s) named above and may contain information that is privileged, exempt from disclosure under applicable law. If you are not the intended recipient, do not disclose or disseminate the message to anyone except the intended recipient. If you have received this message in error, or are not the named recipient(s), please immediately notify the sender by return email, and delete all copies of this message.