Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - pig-0.10.0: TestJobSubmission failed with: Internal error creating job configuration.


Copy link to this message
-
Re: Re: pig-0.10.0: TestJobSubmission failed with: Internal error creating job configuration.
Cheolsoo Park 2012-08-18, 06:26
Hi,

I tried the same version of libraries as you're using and was able to get
TestHBaseStorage passing in trunk. Here is what I did:

1) Updated the version of hadoop, hbase, and zookeeper in
ivy/libraries.properties:

hadoop-core.version=1.0.3
> hadoop-test.version=1.0.3
> hbase.version=0.94.0
> zookeeper.version=3.4.3
2) Updated TestHBaseStorage.java since it doesn't compile with hbase-0.94.0:

HTable table = new HTable(tableName); => HTable table = new HTable(conf,
> tableName);
There are 6 places to fix.

3) Added the following lines to ivy.xml:

<dependency org="com.github.stephenc.high-scale-lib" name="high-scale-lib"
> rev="${high-scale-lib.version}" conf="test->default"/>
> <dependency org="com.google.protobuf" name="protobuf-java"
> rev="${protobuf-java.version}" conf="test->default"/>
I also added the following line to ivy/libraries.properties:

high-scale-lib.version=1.1.1
In particular, I was able to reproduce your error without this line in
ivy.xml:

<dependency org="com.google.protobuf" name="protobuf-java"
> rev="${protobuf-java.version}" conf="test->default"/>
With all these changes, TestHBaseStorage passes for me. Please let me know
if this works for you.

Thanks,
Cheolsoo

On Thu, Aug 16, 2012 at 11:02 PM, lulynn_2008 <[EMAIL PROTECTED]> wrote:

> BTW, I am using hadoop-1.0.3, hbase-0.94.0 and zookeeper-3.4.3.
>
>
> Hi Cheolsoo,
> You are right. TestHBaseStorage also failed with the same error.
>
> I got following region server information, and seems hbase region has been
> started successfully. But hbase can not connect to zookeeper
>
> 12/08/13 06:34:12 INFO server.PrepRequestProcessor: Got user-level
> KeeperException when processing sessionid:0x1391cf90aed0000 type:delete
> cxid:0x24 zxid:0x10 txntype:-1 reqpath:n/a Error
> Path:/hbase/root-region-server Error:KeeperErrorCode = NoNode for
> /hbase/root-region-server
>
> 12/08/13 06:34:16 INFO regionserver.HRegion: creating HRegion pigtable_1
> HTD == {NAME => 'pigtable_1', FAMILIES => [{NAME => 'pig',
> REPLICATION_SCOPE => '0', KEEP_DELETED_CELLS => 'false', COMPRESSION =>
> 'NONE', ENCODE_ON_DISK => 'true', BLOCKCACHE => 'true', MIN_VERSIONS =>
> '0', DATA_BLOCK_ENCODING => 'NONE', IN_MEMORY => 'false', BLOOMFILTER =>
> 'NONE', TTL => '2147483647', VERSIONS => '3', BLOCKSIZE => '65536'}]}
> RootDir = hdfs://shihc015:54670/user/root/hbase Table name == pigtable_1
>
> 12/08/13 06:34:43 INFO zookeeper.ClientCnxn: Opening socket connection to
> server shihc015/127.0.0.1:21818
> 12/08/13 06:34:43 WARN client.ZooKeeperSaslClient: SecurityException:
> java.lang.SecurityException: Unable to locate a login configuration
> occurred when trying to find JAAS configuration.
> 12/08/13 06:34:43 INFO client.ZooKeeperSaslClient: Client will not
> SASL-authenticate because the default JAAS configuration section 'Client'
> could not be found. If you are not using SASL, you may ignore this. On the
> other hand, if you expected SASL to work, please fix your JAAS
> configuration.
> 12/08/13 06:34:43 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:610)
>         at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:286)
>         at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1035)
> 12/08/13 06:34:43 WARN zookeeper.RecoverableZooKeeper: Possibly transient
> ZooKeeper exception:
> org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/root-region-server
>
>
> 12/08/16 22:33:05 ERROR zookeeper.ZooKeeperWatcher: hconnection Received
> unexpected KeeperException, re-throwing exception
> org.apache.zookeeper.KeeperException$ConnectionLossException:
> KeeperErrorCode = ConnectionLoss for /hbase/root-region-server