Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Java API ignores config for hbase.zookeeper.quorum and hbase.zookeeper.property.clientPort


Copy link to this message
-
Re: Java API ignores config for hbase.zookeeper.quorum and hbase.zookeeper.property.clientPort
Ted Yu 2013-03-24, 13:58
To pick up zookeeper setting (and others), prefix your command line with:

`$HBASE_HOME/bin/hbase classpath`

Cheers

On Sat, Mar 23, 2013 at 11:37 PM, Joel Alexandre
<[EMAIL PROTECTED]>wrote:

> Hi,
>
> i'm doing a test project with hadoop and hbase. My current cluster has 2
> Ubuntu VMs hosted on a windows machine.
>
> Using the Java HBASE API, i can PUT, QUERY and DELETE row remotly (in my
> host machine) using
>
> config = HBaseConfiguration.create();
> config.set("hbase.zookeeper.quorum", "192.168.56.90");
> config.set("hbase.zookeeper.property.clientPort", "2222");
>
> When i tried running a hbase mapreduce job on windows with the same config
> as above, i get a
>
>     13/03/24 06:11:03 ERROR security.UserGroupInformation:
> PriviledgedActionException as:Joel cause:java.io.IOException: Failed to set
> permissions of path: \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging
> to 0700
> java.io.IOException: Failed to set permissions of path:
> \tmp\hadoop-Joel\mapred\staging\Joel290889388\.staging to 0700
>
> From what i found in the web, it's a problem o running mapreduce jobs in
> windows.
>
> So i tried the mapreduce job in Linux by using "java - jar MR.jar" file.
>
> In linux, i can't connect to zookeeper. For some reason, the zookeeper host
> and port are reset in the client
>
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
> environment:os.version=3.5.0-23-generic
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client environment:user.name
> =hduser
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
> environment:user.home=/home/hduser
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Client
> environment:user.dir=/home/hduser/testes
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Initiating client connection,
> connectString=192.168.56.90:2222 sessionTimeout=180000 watcher=hconnection
> 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 11552@node01
> 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to
> server node01/*192.168.56.90:2222*. Will not attempt to authenticate using
> SASL (unknown error)
> 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Socket connection established
> to node01/192.168.56.90:2222, initiating session*
> 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: *Session establishment
> complete on server node01/192.168.56.90:2222*, sessionid > 0x13d9afaa1a30006, negotiated timeout = 180000
> 13/03/24 05:59:33 INFO client.HConnectionManager$HConnectionImplementation:
> Closed zookeeper sessionid=0x13d9afaa1a30006
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: Session: 0x13d9afaa1a30006
> closed
> 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: EventThread shut down
> 13/03/24 05:59:33 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 13/03/24 05:59:33 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
> 13/03/24 05:59:33 INFO zookeeper.ZooKeeper: *Initiating client connection,
> connectString=localhost:2181 *sessionTimeout=180000 watcher=hconnection
> 13/03/24 05:59:33 INFO zookeeper.RecoverableZooKeeper: The identifier of
> this process is 11552@node01
> 13/03/24 05:59:33 INFO zookeeper.ClientCnxn: Opening socket connection to
> server localhost/127.0.0.1:2181. Will not attempt to authenticate using
> SASL (unknown error)
> 13/03/24 05:59:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
> unexpected error, closing socket connection and attempting reconnect
> java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:692)
>         at
>
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>
> Looking at the above log, it connects correctly to
> 192.168.56.90:2222(node01 resolves to 192.168.56.90). But for some