Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive >> mail # user >> cli timeouts


+
Travis Crawford 2012-08-01, 16:01
+
Edward Capriolo 2012-08-01, 18:31
+
Travis Crawford 2012-08-01, 18:35
+
Edward Capriolo 2012-08-01, 18:47
+
Travis Crawford 2012-08-01, 18:54
Copy link to this message
-
Re: cli timeouts
The two setup options are:

cli->thriftmetastore->jdbc

cli->jdbc (used to be called local mode)

localmode has less moving parts so I prefer it.

On Wed, Aug 1, 2012 at 2:54 PM, Travis Crawford
<[EMAIL PROTECTED]> wrote:
> Oh interesting - you're saying instead of running a single
> HiveMetaStore thrift service, most users use the embedded
> HiveMetaStore mode and have each CLI instance connect to the DB
> directly?
>
> --travis
>
>
> On Wed, Aug 1, 2012 at 11:47 AM, Edward Capriolo <[EMAIL PROTECTED]> wrote:
>> I feel that that interface is very rarely used in the wild. The only
>> use case I can figure out for it is people with very in depth hive
>> experience that do not wish to interact with hive through the QL
>> language. That being said I would think the coverage might be a little
>> weak there. With the local metastore users have data nucleus providing
>> support for reconnection etc.
>>
>> On Wed, Aug 1, 2012 at 2:35 PM, Travis Crawford
>> <[EMAIL PROTECTED]> wrote:
>>> I'm using the thrift metastore via TFramedTransport. What value do you
>>> specify for hive.metastore.client.socket.timeout? I'm using 60.
>>>
>>> If I open the CLI, run "show tables", wait the timeout period, then
>>> run "show tables" the CLI hangs in:
>>>
>>> "main" prio=10 tid=0x000000004151a000 nid=0x448 runnable [0x0000000041b42000]
>>>    java.lang.Thread.State: RUNNABLE
>>>         at java.net.SocketInputStream.socketRead0(Native Method)
>>>         at java.net.SocketInputStream.read(SocketInputStream.java:129)
>>>         at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
>>>         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
>>>         at org.apache.thrift.transport.TFramedTransport.readFrame(TFramedTransport.java:129)
>>>         at org.apache.thrift.transport.TFramedTransport.read(TFramedTransport.java:101)
>>>         at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
>>>         at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
>>>         at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
>>>         at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
>>>         at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:69)
>>>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.recv_get_database(ThriftHiveMetastore.java:374)
>>>         at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.get_database(ThriftHiveMetastore.java:361)
>>>         at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getDatabase(HiveMetaStoreClient.java:705)
>>>         at org.apache.hadoop.hive.ql.metadata.Hive.getDatabase(Hive.java:1077)
>>>         at org.apache.hadoop.hive.ql.metadata.Hive.databaseExists(Hive.java:1066)
>>>         at org.apache.hadoop.hive.ql.exec.DDLTask.showTables(DDLTask.java:2004)
>>>         at org.apache.hadoop.hive.ql.exec.DDLTask.execute(DDLTask.java:325)
>>>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:134)
>>>         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>>>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1329)
>>>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1115)
>>>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:948)
>>>         at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
>>>         at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:216)
>>>         at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:412)
>>>         at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:750)
>>>         at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:613)
>>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
+
Travis Crawford 2012-08-01, 19:02
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB