Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> zookeeper error when using HS2 in Hive 0.12


Copy link to this message
-
Re: zookeeper error when using HS2 in Hive 0.12
I found two additional exception in HiveServer2 log, it might be the root
cause?

1.
2013-11-03 01:12:07,586 WARN  *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:checkRedundantNode(633))
- Error in checkRedundantNode for node /hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
 at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468
 at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1496)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.checkRedundantNode(ZooKeeperHiveLockManager.java:622)
 at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.removeAllRedundantNodes(ZooKeeperHiveLockManager.java:605)
at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.close(ZooKeeperHiveLockManager.java:647)
 at org.apache.hadoop.hive.ql.Driver.destroy(Driver.java:1567)

2.
2013-11-03 01:12:07,664 WARN  *ZooKeeperHiveLockManager*
(ZooKeeperHiveLockManager.java:setContext(125))
- Unexpected ZK exception when creating parent node
/hive_zookeeper_namespace
org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hive_zookeeper_namespace
at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
 at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
 at
org.apache.hadoop.hive.ql.lockmgr.zookeeper.ZooKeeperHiveLockManager.setContext(ZooKeeperHiveLockManager.java:121)
at org.apache.hadoop.hive.ql.Driver.setLockManager(Driver.java:174)
 at org.apache.hadoop.hive.ql.Driver.checkLockManager(Driver.java:146)
at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:985)
 at org.apache.hadoop.hive.ql.Driver.run(Driver.java:888)
On Sat, Nov 2, 2013 at 2:21 AM, Zhang Xiaoyu <[EMAIL PROTECTED]>wrote:

> anyone seen this before? BTW, I am using a tarball, not sure if any
> additional configuration is needed. Thanks in advance.
>
> Johnny
>
>
> On Tue, Oct 22, 2013 at 5:38 PM, Zhang Xiaoyu <[EMAIL PROTECTED]>wrote:
>
>> Hi, all,
>> I set up below property in hive-site.xml.
>>
>> hive.support.concurrency=true
>> hive.zookeeper.quorum=xxxxxxxx
>>
>> But when I HiveServer2 got multiple concurrent query. I see zookeeper
>> exception in hive.log. Anyone has idea about it? Is there any additional
>> configuration properties in hive 0.12 ? Since after restart HS2, the issue
>> is gone, so I think it is not zk issue.
>>
>> 2013-10-23 00:31:50,683 WARN  zookeeper.ClientCnxn
>> (ClientCnxn.java:run(1057)) - Session 0x0 for server xxxxxxxxxxxxx/
>> 17.198.227.144:2181, unexpected error, closing socket connection and
>> attempting reconnect
>> java.io.IOException: Connection reset by peer
>>         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
>>         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
>>         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:225)
>>         at sun.nio.ch.IOUtil.read(IOUtil.java:193)
>>         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:359)
>>         at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:66)
>>         at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:291)
>>         at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
>>
>> Johnny
>>
>
>