Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> zookeeper error when using HS2 in Hive 0.12


Copy link to this message
-
Re: zookeeper error when using HS2 in Hive 0.12
I found two additional exception in HiveServer2 log, it might be the root
cause?

1.
2013-11-03 01:12:07,586 WARN  *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:checkRedundantNode(633))
- Error in checkRedundantNode for node /hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
 at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468
 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.checkRedundantNode(ZooKeeperHiveLockManager.java:622)
 at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.removeAllRedundantNodes(ZooKeeperHiveLockManager.java:605)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.close(ZooKeeperHiveLockManager.java:647)
 at org.apache.hadoop.hive.ql.Driver.destroy(Driver.java:1567)

2.
2013-11-03 01:12:07,664 WARN  *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:setContext(125))
- Unexpected ZK exception when creating parent node
/hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
 at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
 at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.setContext(ZooKeeperHiveLockManager.java:121)
at org.apache.hadoop.hive.ql.Driver.setLockManager(Driver.java:174)
 at org.apache.hadoop.hive.ql.Driver.checkLockManager(Driver.java:146)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:985)
 at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
On Sat, Nov 2, 2013 at 2:21 AM, Zhang Xiaoyu <[EMAIL PROTECTED]>wrote:

> anyone seen this before? BTW, I am using a tarball, not sure if any
> additional configuration is needed. Thanks in advance.
>
> Johnny
>
>
> On Tue, Oct 22, 2013 at 5:38 PM, Zhang Xiaoyu <[EMAIL PROTECTED]>wrote:
>
>> Hi, all,
>> I set up below property in hive-site.xml.
>>
>> hive.support.concurrency=true
>> hive.zookeeper.quorum=xxxxxxxx
>>
>> But when I HiveServer2 got multiple concurrent query. I see zookeeper
>> exception in hive.log. Anyone has idea about it? Is there any additional
>> configuration properties in hive 0.12 ? Since after restart HS2, the issue
>> is gone, so I think it is not zk issue.
>>
>> 2013-10-23 00:31:50,683 WARN  zookeeper.ClientCnxn
>> (ClientCnxn.java:run(1057)) - Session 0x0 for server xxxxxxxxxxxxx/
>> 17.198.227.144:2181, unexpected error, closing socket connection and
>> attempting reconnect
>> java.io.IOException: Connection reset by peer
>>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
>>         at sun.nio.ch.IOUtil.read(IOUtil.java:193)
>>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
>>         at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:66)
>>         at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:291)
>>         at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
>>
>> Johnny
>>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB