Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> java.sql.SQLException: org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes.


Copy link to this message
-
RE: java.sql.SQLException: org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes.
Others probably have more insight on this but at least you narrowed it down to the meta store. I've had some concurrency issues with the metastore myself (HIVE-1539) so perhaps you are running into something similar? Perhaps there are some different errors before you see this error/warning like trying to reconnect? I know mysql gave us some problems as a metastore disconnecting connections after a wait_time expired in the past.

________________________________
From: lei liu [mailto:[EMAIL PROTECTED]]
Sent: Monday, August 23, 2010 10:25 AM
To: [EMAIL PROTECTED]
Subject: Re: java.sql.SQLException: org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes.

Hi [images/cleardot.gif] [images/cleardot.gif] Bennie,
Thank you for your reply

I see there is below exception in hive.log :
10/08/23 14:06:23 INFO Datastore.Retrieve: Object with id "3211[OID]org.apache.hadoop.hive.metastore.model.MStorageDescriptor" not found !
10/08/23 14:06:23 ERROR server.TThreadPoolServer: Error occurred during processing of message.
java.lang.RuntimeException: org.apache.thrift.TException: org.apache.thrift.TException: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch user root
        at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:397)
        at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:245)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.thrift.TException: org.apache.thrift.TException: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch user root
        at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.<init>(HiveServer.java:109)
        at org.apache.hadoop.hive.service.HiveServer$ThriftHiveProcessorFactory.getProcessor(HiveServer.java:394)
        ... 4 more
Caused by: org.apache.thrift.TException: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch user root
        at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.verify(HiveServer.java:369)
        at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.<init>(HiveServer.java:106)
        ... 5 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to fetch user root
        at org.apache.hadoop.hive.ql.metadata.Hive.getUser(Hive.java:363)
        at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.verify(HiveServer.java:365)
        ... 6 more
Caused by: javax.jdo.JDOObjectNotFoundException: No such database row
FailedObject:3211[OID]org.apache.hadoop.hive.metastore.model.MStorageDescriptor
        at org.datanucleus.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:308)
        at org.datanucleus.jdo.JDOTransaction.commit(JDOTransaction.java:132)
        at org.apache.hadoop.hive.metastore.ObjectStore.commitTransaction(ObjectStore.java:229)
        at org.apache.hadoop.hive.metastore.ObjectStore.getUser(ObjectStore.java:944)
        at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_user(HiveMetaStore.java:324)
        at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getUser(HiveMetaStoreClient.java:318)
        at org.apache.hadoop.hive.ql.metadata.Hive.getUser(Hive.java:352)
        ... 7 more

what is mean the exception?
2010/8/23 Bennie Schut <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
The real reason is probably in the log of the hiveserver. It should be in the console you started the hiveserver in. I sometimes start it like this:
nohup ./hive --service hiveserver >hive.log &
Which would show you some errors in the hive.log file.
We used to have some problems with PermGen issues because of a classloading/unloading issue in one of our udfs which would show itself with an error like this. It is however a pretty generic error which is telling you the "hiveserver" is probably having a problem and you need to take a look at the logs.

________________________________
From: lei liu [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Monday, August 23, 2010 9:48 AM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: java.sql.SQLException: org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes.

Yes, you are right. I do that, but after the hive server run several days, when client connection the hive server, the client receive the exception.
2010/8/23 Adarsh Sharma <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
For Running Hive in Server Mode ..
First U have to start service of hiveserver ::
*$bin/hive --service hiveserver
*

and then run the code
lei liu wrote:
Hello everyone,
I use JDBC to connection the hive server, sometime I receive below exception:
java.sql.SQLException: org.apache.thrift.transport.TTransportException: Cannot read. Remote side has closed. Tried to read 1 bytes, but only got 0 bytes.

Please tell me the eason.
Thanks
LiuLei
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB