|
Dalia Sobhy
2012-05-12, 11:44
Harsh J
2012-05-12, 11:58
Dalia Sobhy
2012-05-12, 12:36
Harsh J
2012-05-12, 12:57
shashwat shriparv
2012-05-12, 14:45
shashwat shriparv
2012-05-12, 14:52
Dalia Sobhy
2012-05-12, 17:17
Shashwat
2012-05-12, 18:01
Dalia Sobhy
2012-05-12, 18:26
shashwat shriparv
2012-05-13, 17:21
Dalia Sobhy
2012-05-14, 10:20
Dalia Sobhy
2012-05-14, 13:21
N Keywal
2012-05-14, 14:06
Dalia Sobhy
2012-05-14, 15:17
N Keywal
2012-05-14, 15:28
Dalia Sobhy
2012-05-14, 16:45
shashwat shriparv
2012-05-17, 20:22
Dalia Sobhy
2012-05-18, 10:48
Dalia Sobhy
2012-05-18, 10:50
shashwat shriparv
2012-05-18, 11:40
Dalia Sobhy
2012-05-18, 12:22
shashwat shriparv
2012-05-18, 20:05
Dalia Sobhy
2012-05-19, 19:33
Mohammad Tariq
2012-05-20, 10:16
shashwat shriparv
2012-05-20, 13:33
|
-
Important "Undefined Error"Dalia Sobhy 2012-05-12, 11:44
Dear all, I have first a problem with Hbase I am trying to install it on a distributed/multinode cluster.. I am using the cloudera https://ccp.cloudera.com/display/CDH4B2/HBase+Installation#HBaseInstallation-StartingtheHBaseMaster But when I write this command Creating the /hbase Directory in HDFS $sudo -u hdfs hadoop fs -mkdir /hbase I get the following error:12/05/12 07:20:42 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing. And in all the next commands.. So any Help?? 2. Another Aspect is when I start the hbase master it closes automatically after a while. 3. Also this command is not working$host -v -t A `namenode`namenode: command not found Although when I run this command $hostname the output is namenode So any help plz because I have deadlines and I want to test my application on hadoop's Hbase fully distributed mode... Thanks,
-
Re: Important "Undefined Error"Harsh J 2012-05-12, 11:58
Hi Dalia,
On Sat, May 12, 2012 at 5:14 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: > > Dear all, > I have first a problem with Hbase I am trying to install it on a distributed/multinode cluster.. > I am using the cloudera https://ccp.cloudera.com/display/CDH4B2/HBase+Installation#HBaseInstallation-StartingtheHBaseMaster > But when I write this command > Creating the /hbase Directory in HDFS $sudo -u hdfs hadoop fs -mkdir /hbase > I get the following error:12/05/12 07:20:42 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing. This is not an error and you shouldn't be worried. It is rather a noisy INFO log that should be fixed (as a DEBUG level instead) in subsequent releases (Are you using CDH3 or CDH4? IIRC only CDH3u3 printed these, not in anything above that.) > 2. Another Aspect is when I start the hbase master it closes automatically after a while. Could you post us your HMaster start->crash log? You can use a service like pastebin.com to send us the output. > 3. Also this command is not working$host -v -t A `namenode`namenode: command not found The right command is perhaps just: $host -v -t A `hostname` -- Harsh J
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-12, 12:36
Dear Harsh When I run $hbase master start I found the following errors:12/05/12 08:32:42 INFO ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=6000012/05/12 08:32:42 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server Responder: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server listener on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 0 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 1 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 2 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 3 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 5 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 4 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 7 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Serv er handler 6 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 8 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 9 on 60000: starting12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 GMT12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:host.name=namenode12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_3012/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.30/jre12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3.jar:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/u sr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.5.4.jar:/usr/lib/hbase/bin/../lib/avro-ipc-1.5.4.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/guava-r09-jarjar.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/l ib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.6.0.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/ ../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/velocity-1.5.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/etc/zookeeper:/etc/hadoop-0.20/conf:/usr/lib/hadoop-0.20/hadoop-examples.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u3-core.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u3-ant.jar:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u3.jar:/usr/lib/hadoop-0.20/hadoop-test.jar:/usr/lib/hadoop-0.20/hadoop-ant-0.20.2-cdh3u3.jar:/usr/lib/hadoop-0.20/hadoop-tools.jar:/usr/lib/hadoop-0.20/hadoop-tools-0.20.2-cdh3u3.jar:/usr/lib/hadoop-0.20/hadoop-test-0.20.2-cdh3u3.jar:/usr/lib/hadoop-0.20/hadoop-core.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u3-examples.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u3-test.jar:/usr/lib/hadoop-0.20/hadoop-ant.jar:/usr/lib/hadoop-0.20/hadoop-examples-0.20.2-cdh3u3.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u3-tools.jar:/usr/lib/hadoop-0.20/lib/jasper-runtime-5.5.12.jar:/usr/lib /hadoop-0.20/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20/lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/lib/jetty-servlet-tester-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/jackson-core-asl-1.5.2.jar:/usr/lib/hadoop-0.20/lib/oro-2.0.8.jar:/usr/lib/hadoop-0.20/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20/lib/commons-daemon-1.0.1.jar:/usr/lib/hadoop-0.20/lib/mockito-all-1.8.2.jar:/usr/lib/hadoop-0.20/lib/aspectjrt-1.6.5.jar:/usr/lib/hadoop-0.20/lib/commons-lang-2.4.jar:/usr/lib/hadoop-0.20/lib/junit-4.5.jar:/usr/lib/hadoop-0.20/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20/lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hadoop-0.20/lib/log4j-1.2.15.jar:/usr/lib/hadoop-0.20/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20/lib/core-3.1.1.jar:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/lib/jetty-util-6.1.26.cloudera.1.jar:/usr/lib/h
-
Re: Important "Undefined Error"Harsh J 2012-05-12, 12:57
Dalia,
Is your NameNode running fine? The issue is that HBase Master has been asked to talk to HDFS, but it can't connect to the HDFS NameNode. Does "hadoop dfs -touchz foobar" pass or fail with similar retry issues? What's your fs.default.name's value in Hadoop's core-site.xml? And whats the output of that fixed host command I'd posted before? On Sat, May 12, 2012 at 6:06 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: > > > Dear Harsh > When I run $hbase master start > I found the following errors:12/05/12 08:32:42 INFO ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, port=6000012/05/12 08:32:42 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server Responder: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server listener on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 0 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 1 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 2 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 3 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 5 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 4 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 7 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Serv > er handler 6 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 8 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 9 on 60000: starting12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 GMT12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:host.name=namenode12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_3012/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.30/jre12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3.jar:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/u > sr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.5.4.jar:/usr/lib/hbase/bin/../lib/avro-ipc-1.5.4.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/guava-r09-jarjar.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/l > ib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.6.0.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/ Harsh J
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-12, 14:45
First thing copy core-site.xml, dfs xml from hadoop conf directory to hbase
conf dirctory. and turn of hadoop save mode and then try... On Sat, May 12, 2012 at 6:27 PM, Harsh J <[EMAIL PROTECTED]> wrote: > Dalia, > > Is your NameNode running fine? The issue is that HBase Master has been > asked to talk to HDFS, but it can't connect to the HDFS NameNode. Does > "hadoop dfs -touchz foobar" pass or fail with similar retry issues? > > What's your fs.default.name's value in Hadoop's core-site.xml? And > whats the output of that fixed host command I'd posted before? > > On Sat, May 12, 2012 at 6:06 PM, Dalia Sobhy <[EMAIL PROTECTED]> > wrote: > > > > > > Dear Harsh > > When I run $hbase master start > > I found the following errors:12/05/12 08:32:42 INFO ipc.HBaseRpcMetrics: > Initializing RPC Metrics with hostName=HMaster, port=6000012/05/12 08:32:42 > INFO security.UserGroupInformation: JAAS Configuration already set up for > Hadoop, not re-installing.12/05/12 08:32:42 INFO ipc.HBaseServer: IPC > Server Responder: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC > Server listener on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: > IPC Server handler 0 on 60000: starting12/05/12 08:32:42 INFO > ipc.HBaseServer: IPC Server handler 1 on 60000: starting12/05/12 08:32:42 > INFO ipc.HBaseServer: IPC Server handler 2 on 60000: starting12/05/12 > 08:32:42 INFO ipc.HBaseServer: IPC Server handler 3 on 60000: > starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 5 on > 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 4 > on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server > handler 7 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Serv > > er handler 6 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: > IPC Server handler 8 on 60000: starting12/05/12 08:32:42 INFO > ipc.HBaseServer: IPC Server handler 9 on 60000: starting12/05/12 08:32:42 > INFO zookeeper.ZooKeeper: Client > environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 > GMT12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment: > host.name=namenode12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client > environment:java.version=1.6.0_3012/05/12 08:32:42 INFO > zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems > Inc.12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.30/jre12/05/12 08:32:42 > INFO zookeeper.ZooKeeper: Client > environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3.jar:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/u > > > sr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.5.4.jar:/usr/lib/hbase/bin/../lib/avro-ipc-1.5.4.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/guava-r09-jarjar.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/l > > > ib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-complete-1.6.0.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/ ∞ Shashwat Shriparv
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-12, 14:52
you can turn off hadoop safe mode uisng *hadoop dfsadmin -safemode leave*
On Sat, May 12, 2012 at 8:15 PM, shashwat shriparv < [EMAIL PROTECTED]> wrote: > First thing copy core-site.xml, dfs xml from hadoop conf directory to > hbase conf dirctory. and turn of hadoop save mode and then try... > > > On Sat, May 12, 2012 at 6:27 PM, Harsh J <[EMAIL PROTECTED]> wrote: > >> Dalia, >> >> Is your NameNode running fine? The issue is that HBase Master has been >> asked to talk to HDFS, but it can't connect to the HDFS NameNode. Does >> "hadoop dfs -touchz foobar" pass or fail with similar retry issues? >> >> What's your fs.default.name's value in Hadoop's core-site.xml? And >> whats the output of that fixed host command I'd posted before? >> >> On Sat, May 12, 2012 at 6:06 PM, Dalia Sobhy <[EMAIL PROTECTED]> >> wrote: >> > >> > >> > Dear Harsh >> > When I run $hbase master start >> > I found the following errors:12/05/12 08:32:42 INFO >> ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HMaster, >> port=6000012/05/12 08:32:42 INFO security.UserGroupInformation: JAAS >> Configuration already set up for Hadoop, not re-installing.12/05/12 >> 08:32:42 INFO ipc.HBaseServer: IPC Server Responder: starting12/05/12 >> 08:32:42 INFO ipc.HBaseServer: IPC Server listener on 60000: >> starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 0 on >> 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server handler 1 >> on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC Server >> handler 2 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: IPC >> Server handler 3 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: >> IPC Server handler 5 on 60000: starting12/05/12 08:32:42 INFO >> ipc.HBaseServer: IPC Server handler 4 on 60000: starting12/05/12 08:32:42 >> INFO ipc.HBaseServer: IPC Server handler 7 on 60000: starting12/05/12 >> 08:32:42 INFO ipc.HBaseServer: IPC Serv >> > er handler 6 on 60000: starting12/05/12 08:32:42 INFO ipc.HBaseServer: >> IPC Server handler 8 on 60000: starting12/05/12 08:32:42 INFO >> ipc.HBaseServer: IPC Server handler 9 on 60000: starting12/05/12 08:32:42 >> INFO zookeeper.ZooKeeper: Client >> environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 >> GMT12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client environment: >> host.name=namenode12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client >> environment:java.version=1.6.0_3012/05/12 08:32:42 INFO >> zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems >> Inc.12/05/12 08:32:42 INFO zookeeper.ZooKeeper: Client >> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.30/jre12/05/12 08:32:42 >> INFO zookeeper.ZooKeeper: Client >> environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3.jar:/usr/lib/hbase/bin/../hbase-0.90.4-cdh3u3-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/u >> > >> sr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.5.4.jar:/usr/lib/hbase/bin/../lib/avro-ipc-1.5.4.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commons-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/guava-r09-jarjar.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/l >> ∞ Shashwat Shriparv
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-12, 17:17
Hi Shashwat, I want to tell you about my configurations: I am using 4 nodesOne "Master": Namenode, SecondaryNamenode, Job Tracker, Zookeeper, HMasterThree "Slaves": datanodes, tasktrackers, regionservers In both master and slaves, all the hadoop daemons are working well, but as for the hbase master service it is not working.. As for region server here is the error:12/05/12 14:42:13 INFO util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Sun Microsystems Inc., vmVersion=20.1-b0212/05/12 14:42:13 INFO util.ServerCommandLine: vmInputArguments=[-Xmx1000m, -ea, -XX:+UseConcMarkSweepGC, -XX:+CMSIncrementalMode, -Dhbase.log.dir=/usr/lib/hbase/bin/../logs, -Dhbase.log.file=hbase.log, -Dhbase.home.dir=/usr/lib/hbase/bin/.., -Dhbase.id.str=, -Dhbase.root.logger=INFO,console, -Djava.library.path=/usr/lib/hadoop-0.20/lib/native/Linux-amd64-64:/usr/lib/hbase/bin/../lib/native/Linux-amd64-64]12/05/12 14:42:13 INFO ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=6002012/05/12 14:42:14 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot be set to localhost in a fully-distributed setup because it won't be reachable. See "Getting Started" for more information.12/05/12 14:42:14 WARN zookeeper.ZKConfig: Cannot read zoo.cfg, loading from XML filesjava.io.IOException: The server in zoo.cfg cannot be set to localhost in a fully-distributed setup because it won't be reachable. See "Getting Started" for more information. at org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:172) at org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:68) at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:249) at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:117) at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:489) at org.apache.hadoop.hbase.regionserver.HRegionServer.initialize(HRegionServer.java:465) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:564) at java.lang.Thread.run(Thread.java:662)12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 GMT12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:host.name=data node212/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_2612/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.26/jre12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/jvm/java-6-sun/lib/tools.jar:/usr/lib/hbase/bin/..:/usr/lib/hbase/bin/../hbase-0.90.6-cdh3u4.jar:/usr/lib/hbase/bin/../hbase-0.90.6-cdh3u4-tests.jar:/usr/lib/hbase/bin/../lib/activation-1.1.jar:/usr/lib/hbase/bin/../lib/asm-3.1.jar:/usr/lib/hbase/bin/../lib/avro-1.5.4.jar:/usr/lib/hbase/bin/../lib/avro-ipc-1.5.4.jar:/usr/lib/hbase/bin/../lib/commons-cli-1.2.jar:/usr/lib/hbase/bin/../lib/commons-codec-1.4.jar:/usr/lib/hbase/bin/../lib/commons-el-1.0.jar:/usr/lib/hbase/bin/../lib/commons-httpclient-3.1.jar:/usr/lib/hbase/bin/../lib/commons-lang-2.5.jar:/usr/lib/hbase/bin/../lib/commo ns-logging-1.1.1.jar:/usr/lib/hbase/bin/../lib/commons-net-1.4.1.jar:/usr/lib/hbase/bin/../lib/core-3.1.1.jar:/usr/lib/hbase/bin/../lib/guava-r06.jar:/usr/lib/hbase/bin/../lib/guava-r09-jarjar.jar:/usr/lib/hbase/bin/../lib/hadoop-core.jar:/usr/lib/hbase/bin/../lib/jackson-core-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-jaxrs-1.5.5.jar:/usr/lib/hbase/bin/../lib/jackson-mapper-asl-1.5.2.jar:/usr/lib/hbase/bin/../lib/jackson-xc-1.5.5.jar:/usr/lib/hbase/bin/../lib/jamon-runtime-2.3.1.jar:/usr/lib/hbase/bin/../lib/jasper-compiler-5.5.23.jar:/usr/lib/hbase/bin/../lib/jasper-runtime-5.5.23.jar:/usr/lib/hbase/bin/../lib/jaxb-api-2.1.jar:/usr/lib/hbase/bin/../lib/jaxb-impl-2.1.12.jar:/usr/lib/hbase/bin/../lib/jersey-core-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-json-1.4.jar:/usr/lib/hbase/bin/../lib/jersey-server-1.4.jar:/usr/lib/hbase/bin/../lib/jettison-1.1.jar:/usr/lib/hbase/bin/../lib/jetty-6.1.26.jar:/usr/lib/hbase/bin/../lib/jetty-util-6.1.26.jar:/usr/lib/hbase/bin/../lib/jruby-co mplete-1.6.0.jar:/usr/lib/hbase/bin/../lib/jsp-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1-6.1.14.jar:/usr/lib/hbase/bin/../lib/jsp-api-2.1.jar:/usr/lib/hbase/bin/../lib/jsr311-api-1.1.1.jar:/usr/lib/hbase/bin/../lib/log4j-1.2.16.jar:/usr/lib/hbase/bin/../lib/netty-3.2.4.Final.jar:/usr/lib/hbase/bin/../lib/protobuf-java-2.3.0.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5-6.1.14.jar:/usr/lib/hbase/bin/../lib/servlet-api-2.5.jar:/usr/lib/hbase/bin/../lib/slf4j-api-1.5.8.jar:/usr/lib/hbase/bin/../lib/slf4j-log4j12-1.5.8.jar:/usr/lib/hbase/bin/../lib/snappy-java-1.0.3.2.jar:/usr/lib/hbase/bin/../lib/stax-api-1.0.1.jar:/usr/lib/hbase/bin/../lib/thrift-0.2.0.jar:/usr/lib/hbase/bin/../lib/velocity-1.5.jar:/usr/lib/hbase/bin/../lib/xmlenc-0.52.jar:/usr/lib/hbase/bin/../lib/zookeeper.jar:/etc/zookeeper:/etc/hadoop-0.20/conf:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-ant.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-tools.jar:/usr/lib/hadoop-0.20/hadoop-tools.jar:/usr/lib/hadoop-0.20/ hadoop-examples-0.20.2-cdh3u4.jar:/usr/lib/hadoop-0.20/hadoop-ant-0.20.2-cdh3u4.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-examples.jar:/usr/lib/hadoop-0.20/hadoop-ant.jar:/usr/lib/hadoop-0.20/hadoop-core-0.20.2-cdh3u4.jar:/usr/lib/hadoop-0.20/hadoop-core.jar:/usr/lib/hadoop-0.20/hadoop-tools-0.20.2-cdh3u4.jar:/usr/lib/hadoop-0.20/hadoop-examples.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-core.jar:/usr/lib/hadoop-0.20/hadoop-test-0.20.2-cdh3u4.jar:/usr/lib/hadoop-0.20/hadoop-0.20.2-cdh3u4-test.jar:/usr/lib/hadoop-0.20/hadoop-test.jar:/usr/lib/hadoop-0.20/lib/jetty-6.1.26.cloudera.1.jar:/usr/lib/hadoop-0.20/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20/lib/junit-4.5
-
RE: Important "Undefined Error"Shashwat 2012-05-12, 18:01
The problem is your hbase is not able to connect to Hadoop, can you put your
hbase-site.xml content >> here.. have you specified localhost somewhere, if so remove localhost from everywhere and put your hdfsl namenode address suppose your namenode is running on master:9000 then put your hbase file system setting as master:9000/hbase here I am sending you the configuration which I am using in hbase and is working My hbase-site.xml content is <?xml version="1.0"?> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> <!-- /** * Copyright 2010 The Apache Software Foundation * * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information * regarding copyright ownership. The ASF licenses this file * to you under the Apache License, Version 2.0 (the * "License"); you may not use this file except in compliance * with the License. You may obtain a copy of the License at * * http://www.apache.org/licenses/LICENSE-2.0 * * Unless required by applicable law or agreed to in writing, software * distributed under the License is distributed on an "AS IS" BASIS, * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. * See the License for the specific language governing permissions and * limitations under the License. */ --> <configuration> <property> <name>hbase.rootdir</name> <value>hdfs://master:9000/hbase</value> </property> <property> <name>hbase.master</name> <value>master:60000</value> <description>The host and port that the HBase master runs at.</description> </property> <property> <name>hbase.regionserver.port</name> <value>60020</value> <description>The host and port that the HBase master runs at.</description> </property> <!--<property> <name>hbase.master.port</name> <value>60000</value> <description>The host and port that the HBase master runs at.</description> </property>--> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <property> <name>hbase.tmp.dir</name> <value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>master</value> </property> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2181</value> <description>Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. </description> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>/home/shashwat/zookeeper</value> <description>Property from ZooKeeper's config zoo.cfg. The directory where the snapshot is stored. </description> </property> </configuration> Check this out, and also stop hbase, If its not stopping kill all the processes, and after putting your hdfs-site.xml, mapred-site.xml and core-site.sml to hbase conf directory try to restart, and also delete the folders created by hbase ,,, like temp directory or other then try to start. Regards ∞ Shashwat Shriparv -----Original Message----- From: Dalia Sobhy [mailto:[EMAIL PROTECTED]] Sent: 12 May 2012 22:48 To: [EMAIL PROTECTED] Subject: RE: Important "Undefined Error" Hi Shashwat, I want to tell you about my configurations: I am using 4 nodesOne "Master": Namenode, SecondaryNamenode, Job Tracker, Zookeeper, HMasterThree "Slaves": datanodes, tasktrackers, regionservers In both master and slaves, all the hadoop daemons are working well, but as for the hbase master service it is not working.. As for region server here is the error:12/05/12 14:42:13 INFO util.ServerCommandLine: vmName=Java HotSpot(TM) 64-Bit Server VM, vmVendor=Sun Microsystems Inc., vmVersion=20.1-b0212/05/12 14:42:13 INFO util.ServerCommandLine: vmInputArguments=[-Xmx1000m, -ea, -XX:+UseConcMarkSweepGC, -XX:+CMSIncrementalMode, -Dhbase.log.dir=/usr/lib/hbase/bin/../logs, -Dhbase.log.file=hbase.log, -Dhbase.home.dir=/usr/lib/hbase/bin/.., -Dhbase.id.str=, -Dhbase.root.logger=INFO,console, -Djava.library.path=/usr/lib/hadoop-0.20/lib/native/Linux-amd64-64:/usr/lib/ hbase/bin/../lib/native/Linux-amd64-64]12/05/12 14:42:13 INFO ipc.HBaseRpcMetrics: Initializing RPC Metrics with hostName=HRegionServer, port=6002012/05/12 14:42:14 FATAL zookeeper.ZKConfig: The server in zoo.cfg cannot be set to localhost in a fully-distributed setup because it won't be reachable. See "Getting Started" for more information.12/05/12 14:42:14 WARN zookeeper.ZKConfig: Cannot read zoo.cfg, loading from XML filesjava.io.IOException: The server in zoo.cfg cannot be set to localhost in a fully-distributed setup because it won't be reachable. See "Getting Started" for more information. at org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:172) at org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:68) at org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig .java:249) at org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.j ava:117) at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegi onServer.java:489) at org.apache.hadoop.hbase.regionserver.HRegionServer.initialize(HRegionServer. java:465) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:56 4) at java.lang.Thread.run(Thread.java:662)12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.3.5-cdh3u4--1, built on 05/07/2012 21:12 GMT12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:host.name=data node212/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_2612/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/lib/jvm/java-6-sun-1. 6.0.26/jre12/05/12 14:42:14 INFO zookeeper.ZooKeeper: Client environment:java.class.path=/usr/lib/hbase/bin/../conf:/usr/lib/
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-12, 18:26
Hi Shashwat, I will try it but can u send me your core-site.xml and mapred-site.xml, hdfs-site.xml as well. Have u added any lines to zoo.cfg ??? > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: RE: Important "Undefined Error" > Date: Sat, 12 May 2012 23:31:49 +0530 > > The problem is your hbase is not able to connect to Hadoop, can you put your > hbase-site.xml content >> here.. have you specified localhost somewhere, if > so remove localhost from everywhere and put your hdfsl namenode address > suppose your namenode is running on master:9000 then put your hbase file > system setting as master:9000/hbase here I am sending you the configuration > which I am using in hbase and is working > > > My hbase-site.xml content is > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <!-- > /** > * Copyright 2010 The Apache Software Foundation > * > * Licensed to the Apache Software Foundation (ASF) under one > * or more contributor license agreements. See the NOTICE file > * distributed with this work for additional information > * regarding copyright ownership. The ASF licenses this file > * to you under the Apache License, Version 2.0 (the > * "License"); you may not use this file except in compliance > * with the License. You may obtain a copy of the License at > * > * http://www.apache.org/licenses/LICENSE-2.0 > * > * Unless required by applicable law or agreed to in writing, software > * distributed under the License is distributed on an "AS IS" BASIS, > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > * See the License for the specific language governing permissions and > * limitations under the License. > */ > --> > <configuration> > <property> > <name>hbase.rootdir</name> > <value>hdfs://master:9000/hbase</value> > </property> > <property> > <name>hbase.master</name> > <value>master:60000</value> > <description>The host and port that the HBase master runs at.</description> > </property> > <property> > <name>hbase.regionserver.port</name> > <value>60020</value> > <description>The host and port that the HBase master runs at.</description> > </property> > <!--<property> > <name>hbase.master.port</name> > <value>60000</value> > <description>The host and port that the HBase master runs at.</description> > </property>--> > <property> > <name>hbase.cluster.distributed</name> > <value>true</value> > </property> > <property> > <name>hbase.tmp.dir</name> > <value>/home/shashwat/Hadoop/hbase-0.90.4/temp</value> > </property> > <property> > <name>hbase.zookeeper.quorum</name> > <value>master</value> > </property> > <property> > <name>dfs.replication</name> > <value>1</value> > </property> > <property> > <name>hbase.zookeeper.property.clientPort</name> > <value>2181</value> > <description>Property from ZooKeeper's config zoo.cfg. > The port at which the clients will connect. > </description> > </property> > <property> > <name>hbase.zookeeper.property.dataDir</name> > <value>/home/shashwat/zookeeper</value> > <description>Property from ZooKeeper's config zoo.cfg. > The directory where the snapshot is stored. > </description> > </property> > > </configuration> > > > > > Check this out, and also stop hbase, If its not stopping kill all the > processes, and after putting your hdfs-site.xml, mapred-site.xml and > core-site.sml to hbase conf directory try to restart, and also delete the > folders created by hbase ,,, like temp directory or other then try to start. > > Regards > ∞ > Shashwat Shriparv > > > -----Original Message----- > From: Dalia Sobhy [mailto:[EMAIL PROTECTED]] > Sent: 12 May 2012 22:48 > To: [EMAIL PROTECTED] > Subject: RE: Important "Undefined Error" > > > Hi Shashwat, > I want to tell you about my configurations: > I am using 4 nodesOne "Master": Namenode, SecondaryNamenode, Job Tracker, > Zookeeper, HMasterThree "Slaves": datanodes, tasktrackers, regionservers In > both master and slaves, all the hadoop daemons are working well, but as for
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-13, 17:21
here are the contents of the files:
* * *core-site.xml* <configuration> <property> <name>fs.default.name</name> <value>hdfs://infinity1:9000</value> <description>The name of the default file system. A URI whose scheme and authority determine the FileSystem implementation. The uri's scheme determines the config property (fs.SCHEME.impl) naming the FileSystem implementation class. The uri's authority is used to determine the host, port, etc. for a filesystem.</description> </property> </configuration> *mapred-site.xml* <configuration> <property> <name>mapred.job.tracker</name> <value>infinity1:9001</value> <description>The host and port that the MapReduce job tracker runs at. If "local", then jobs are run in-process as a single map and reduce task. </description></property> </configuration> *hdfs-site.xml* * * <configuration> <property> <name>dfs.replication</name> <value>2</value> <description>Default block replication. The actual number of replications can be specified when the file is created. The default is used if replication is not specified in create time. </description> </property> <property> <name>dfs.name.dir</name> <value>hdfs/name</value> </property> <property> <name>dfs.data.dir</name> <value>hdfs/data</value> </property> <property> <name>hadoop.tmp.dir</name> <value>hdfs/tmp</value> </property> </configuration> *hbase-site.xml* <configuration> <property> <name>hbase.rootdir</name> <value>hdfs://infinity1:9000/hbase</value> </property> <property> <name>hbase.master</name> <value>infinity1:60000</value> <description>The host and port that the HBase master runs at.</description> </property> <property> <name>hbase.regionserver.port</name> <value>60020</value> <description>The host and port that the HBase master runs at.</description> </property> <!--<property> <name>hbase.master.port</name> <value>60000</value> <description>The host and port that the HBase master runs at.</description> </property>--> <property> <name>hbase.cluster.distributed</name> <value>true</value> </property> <property> <name>hbase.tmp.dir</name> <value>~/hbase/tempandlog/temp</value> </property> <property> <name>hbase.zookeeper.quorum</name> <value>infinity1</value> </property> <property> <name>dfs.replication</name> <value>1</value> </property> <property> <name>hbase.zookeeper.property.clientPort</name> <value>2181</value> <description>Property from ZooKeeper's config zoo.cfg. The port at which the clients will connect. </description> </property> <property> <name>hbase.zookeeper.property.dataDir</name> <value>~/hbase/tempandlog/zookeeper</value> <description>Property from ZooKeeper's config zoo.cfg. The directory where the snapshot is stored. </description> </property> </configuration> On Sat, May 12, 2012 at 11:56 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > > > Hi Shashwat, > I will try it but can u send me your core-site.xml and mapred-site.xml, > hdfs-site.xml as well. > Have u added any lines to zoo.cfg ??? > > > > From: [EMAIL PROTECTED] > > To: [EMAIL PROTECTED] > > Subject: RE: Important "Undefined Error" > > Date: Sat, 12 May 2012 23:31:49 +0530 > > > > The problem is your hbase is not able to connect to Hadoop, can you put > your > > hbase-site.xml content >> here.. have you specified localhost somewhere, > if > > so remove localhost from everywhere and put your hdfsl namenode address > > suppose your namenode is running on master:9000 then put your hbase file > > system setting as master:9000/hbase here I am sending you the > configuration > > which I am using in hbase and is working > > > > > > My hbase-site.xml content is > > > > <?xml version="1.0"?> > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <!-- > > /** > > * Copyright 2010 The Apache Software Foundation > > * > > * Licensed to the Apache Software Foundation (ASF) under one > > * or more contributor license agreements. See the NOTICE file > > * distributed with this work for additional information ∞ Shashwat Shriparv
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-14, 10:20
Hi, I tried what you told me, but nothing worked:((( First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> <name>fs.default.name</name> <!--<value>hdfs://namenode:8020</value>--> <value>hdfs://namenode:54310/</value></property></configuration> My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> Please Help I am really disappointed I have been through all that for two weeks !!!! > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: RE: Important "Undefined Error" > Date: Sat, 12 May 2012 23:31:49 +0530 > > The problem is your hbase is not able to connect to Hadoop, can you put your > hbase-site.xml content >> here.. have you specified localhost somewhere, if > so remove localhost from everywhere and put your hdfsl namenode address > suppose your namenode is running on master:9000 then put your hbase file > system setting as master:9000/hbase here I am sending you the configuration > which I am using in hbase and is working > > > My hbase-site.xml content is > > <?xml version="1.0"?> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > <!-- > /** > * Copyright 2010 The Apache Software Foundation > * > * Licensed to the Apache Software Foundation (ASF) under one > * or more contributor license agreements. See the NOTICE file > * distributed with this work for additional information > * regarding copyright ownership. The ASF licenses this file > * to you under the Apache License, Version 2.0 (the > * "License"); you may not use this file except in compliance > * with the License. You may obtain a copy of the License at > * > * http://www.apache.org/licenses/LICENSE-2.0 > * > * Unless required by applicable law or agreed to in writing, software > * distributed under the License is distributed on an "AS IS" BASIS, > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > * See the License for the specific language governing permissions and > * limitations under the License. > */ > --> > <configuration> > <property> > <name>hbase.rootdir</name> > <value>hdfs://master:9000/hbase</value> > </property> > <property> > <name>hbase.master</name> > <value>master:60000</value> > <description>The host and port that the HBase master runs at.</description> > </property> > <property> > <name>hbase.regionserver.port</name> > <value>60020</value> > <description>The host and port that the HBase master runs at.</description> > </property> > <!--<property> > <name>hbase.master.port</name> > <value>60000</value> > <description>The host and port that the HBase master runs at.</description>
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-14, 13:21
pleaseeeeeeeeeeee helpppppppppppppppppppp > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: RE: Important "Undefined Error" > Date: Mon, 14 May 2012 12:20:18 +0200 > > > > Hi, > I tried what you told me, but nothing worked:((( > First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> <name>fs.default.name</name> <!--<value>hdfs://namenode:8020</value>--> <value>hdfs://namenode:54310/</value></property></configuration> > My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> > My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> > My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> > Please Help I am really disappointed I have been through all that for two weeks !!!! > > > > > From: [EMAIL PROTECTED] > > To: [EMAIL PROTECTED] > > Subject: RE: Important "Undefined Error" > > Date: Sat, 12 May 2012 23:31:49 +0530 > > > > The problem is your hbase is not able to connect to Hadoop, can you put your > > hbase-site.xml content >> here.. have you specified localhost somewhere, if > > so remove localhost from everywhere and put your hdfsl namenode address > > suppose your namenode is running on master:9000 then put your hbase file > > system setting as master:9000/hbase here I am sending you the configuration > > which I am using in hbase and is working > > > > > > My hbase-site.xml content is > > > > <?xml version="1.0"?> > > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> > > <!-- > > /** > > * Copyright 2010 The Apache Software Foundation > > * > > * Licensed to the Apache Software Foundation (ASF) under one > > * or more contributor license agreements. See the NOTICE file > > * distributed with this work for additional information > > * regarding copyright ownership. The ASF licenses this file > > * to you under the Apache License, Version 2.0 (the > > * "License"); you may not use this file except in compliance > > * with the License. You may obtain a copy of the License at > > * > > * http://www.apache.org/licenses/LICENSE-2.0 > > * > > * Unless required by applicable law or agreed to in writing, software > > * distributed under the License is distributed on an "AS IS" BASIS, > > * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. > > * See the License for the specific language governing permissions and > > * limitations under the License. > > */ > > --> > > <configuration> > > <property> > > <name>hbase.rootdir</name> > > <value>hdfs://master:9000/hbase</value> > > </property> > > <property> > > <name>hbase.master</name> > > <value>master:60000</value> > > <description>The host and port that the HBase master runs at.</description>
-
Re: Important "Undefined Error"N Keywal 2012-05-14, 14:06
Hi,
There could be multiple issues, but it's strange to have in hbase-site.xml <value>hdfs://namenode:9000/hbase</value> while the core-site.xml says: <value>hdfs://namenode:54310/</value> The two entries should match. I would recommend to: - use netstat to check the ports (netstat -l) - do the check recommended by Harsh J previously. N. On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: > > > pleaseeeeeeeeeeee helpppppppppppppppppppp > >> From: [EMAIL PROTECTED] >> To: [EMAIL PROTECTED] >> Subject: RE: Important "Undefined Error" >> Date: Mon, 14 May 2012 12:20:18 +0200 >> >> >> >> Hi, >> I tried what you told me, but nothing worked:((( >> First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> �� <name>fs.default.name</name> <!--<value>hdfs://namenode:8020</value>--> ��<value>hdfs://namenode:54310/</value></property></configuration> >> My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> >> My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> >> My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> >> Please Help I am really disappointed I have been through all that for two weeks !!!! >> >> >> >> > From: [EMAIL PROTECTED] >> > To: [EMAIL PROTECTED] >> > Subject: RE: Important "Undefined Error" >> > Date: Sat, 12 May 2012 23:31:49 +0530 >> > >> > The problem is your hbase is not able to connect to Hadoop, can you put your >> > hbase-site.xml content >> here.. have you specified localhost somewhere, if >> > so remove localhost from everywhere and put your hdfsl namenode address >> > suppose your namenode is running on master:9000 then put your hbase file >> > system setting as master:9000/hbase here I am sending you the configuration >> > which I am using in hbase and is working >> > >> > >> > My hbase-site.xml content is >> > >> > <?xml version="1.0"?> >> > <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> >> > <!-- >> > /** >> > * Copyright 2010 The Apache Software Foundation >> > * >> > * Licensed to the Apache Software Foundation (ASF) under one >> > * or more contributor license agreements. See the NOTICE file >> > * distributed with this work for additional information >> > * regarding copyright ownership. The ASF licenses this file >> > * to you under the Apache License, Version 2.0 (the >> > * "License"); you may not use this file except in compliance >> > * with the License. You may obtain a copy of the License at >> > * >> > * http://www.apache.org/licenses/LICENSE-2.0 >> > * >> > * Unless required by applicable law or agreed to in writing, software >> > * distributed under the License is distributed on an "AS IS" BASIS,
-
Re: Important "Undefined Error"Dalia Sobhy 2012-05-14, 15:17
Hiiii
I have tried to make both ports the same. But the prob is the hbase cannot connect to port 8020. When i run nmap hostname, port 8020 wasnt with the list of open ports. I have tried what harsh told me abt. I used the same port he used but same error occurred. Another aspect in cloudera doc it says that i have to canonical name for the host ex: namenode.example.com as the hostname, but i didnt find it in any tutorial. No one makes it. Note that i am deploying my cluster in fully distributed mode i.e am using 4 machines.. So any ideas??!! Sent from my iPhone On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > Hi, > > There could be multiple issues, but it's strange to have in hbase-site.xml > > <value>hdfs://namenode:9000/hbase</value> > > while the core-site.xml says: > > <value>hdfs://namenode:54310/</value> > > The two entries should match. > > I would recommend to: > - use netstat to check the ports (netstat -l) > - do the check recommended by Harsh J previously. > > N. > > > On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: >> >> >> pleaseeeeeeeeeeee helpppppppppppppppppppp >> >>> From: [EMAIL PROTECTED] >>> To: [EMAIL PROTECTED] >>> Subject: RE: Important "Undefined Error" >>> Date: Mon, 14 May 2012 12:20:18 +0200 >>> >>> >>> >>> Hi, >>> I tried what you told me, but nothing worked:((( >>> First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> <name>fs.default.name</name> <!--<value>hdfs://namenode:8020</value>--> <value>hdfs://namenode:54310/</value></property></configuration> >>> My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> >>> My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> >>> My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> >>> Please Help I am really disappointed I have been through all that for two weeks !!!! >>> >>> >>> >>>> From: [EMAIL PROTECTED] >>>> To: [EMAIL PROTECTED] >>>> Subject: RE: Important "Undefined Error" >>>> Date: Sat, 12 May 2012 23:31:49 +0530 >>>> >>>> The problem is your hbase is not able to connect to Hadoop, can you put your >>>> hbase-site.xml content >> here.. have you specified localhost somewhere, if >>>> so remove localhost from everywhere and put your hdfsl namenode address >>>> suppose your namenode is running on master:9000 then put your hbase file >>>> system setting as master:9000/hbase here I am sending you the configuration >>>> which I am using in hbase and is working >>>> >>>> >>>> My hbase-site.xml content is >>>> >>>> <?xml version="1.0"?> >>>> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?> >>>> <!-- >>
-
Re: Important "Undefined Error"N Keywal 2012-05-14, 15:28
In core-file.xml, do you have this?
<configuration> <property> <name>fs.default.name</name> <value>hdfs://namenode:8020/hbase</value> </property> If you want hbase to connect to 8020 you must have hdfs listening on 8020 as well. On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: > Hiiii > > I have tried to make both ports the same. > But the prob is the hbase cannot connect to port 8020. > When i run nmap hostname, port 8020 wasnt with the list of open ports. > I have tried what harsh told me abt. > I used the same port he used but same error occurred. > Another aspect in cloudera doc it says that i have to canonical name for the host ex: namenode.example.com as the hostname, but i didnt find it in any tutorial. No one makes it. > Note that i am deploying my cluster in fully distributed mode i.e am using 4 machines.. > > So any ideas??!! > > Sent from my iPhone > > On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > >> Hi, >> >> There could be multiple issues, but it's strange to have in hbase-site.xml >> >> <value>hdfs://namenode:9000/hbase</value> >> >> while the core-site.xml says: >> >> <value>hdfs://namenode:54310/</value> >> >> The two entries should match. >> >> I would recommend to: >> - use netstat to check the ports (netstat -l) >> - do the check recommended by Harsh J previously. >> >> N. >> >> >> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: >>> >>> >>> pleaseeeeeeeeeeee helpppppppppppppppppppp >>> >>>> From: [EMAIL PROTECTED] >>>> To: [EMAIL PROTECTED] >>>> Subject: RE: Important "Undefined Error" >>>> Date: Mon, 14 May 2012 12:20:18 +0200 >>>> >>>> >>>> >>>> Hi, >>>> I tried what you told me, but nothing worked:((( >>>> First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> <name>fs.default.name</name> �� <!--<value>hdfs://namenode:8020</value>--> <value>hdfs://namenode:54310/</value></property></configuration> >>>> My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> >>>> My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> >>>> My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> >>>> Please Help I am really disappointed I have been through all that for two weeks !!!! >>>> >>>> >>>> >>>>> From: [EMAIL PROTECTED] >>>>> To: [EMAIL PROTECTED] >>>>> Subject: RE: Important "Undefined Error" >>>>> Date: Sat, 12 May 2012 23:31:49 +0530 >>>>> >>>>> The problem is your hbase is not able to connect to Hadoop, can you put your >>>>> hbase-site.xml content >> here.. have you specified localhost somewhere, if >>>>> so remove localhost from everywhere and put your hdfsl namenode address
-
Re: Important "Undefined Error"Dalia Sobhy 2012-05-14, 16:45
Yeasss
Sent from my iPhone On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > In core-file.xml, do you have this? > > <configuration> > <property> > <name>fs.default.name</name> > <value>hdfs://namenode:8020/hbase</value> > </property> > > If you want hbase to connect to 8020 you must have hdfs listening on > 8020 as well. > > > On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: >> Hiiii >> >> I have tried to make both ports the same. >> But the prob is the hbase cannot connect to port 8020. >> When i run nmap hostname, port 8020 wasnt with the list of open ports. >> I have tried what harsh told me abt. >> I used the same port he used but same error occurred. >> Another aspect in cloudera doc it says that i have to canonical name for the host ex: namenode.example.com as the hostname, but i didnt find it in any tutorial. No one makes it. >> Note that i am deploying my cluster in fully distributed mode i.e am using 4 machines.. >> >> So any ideas??!! >> >> Sent from my iPhone >> >> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: >> >>> Hi, >>> >>> There could be multiple issues, but it's strange to have in hbase-site.xml >>> >>> <value>hdfs://namenode:9000/hbase</value> >>> >>> while the core-site.xml says: >>> >>> <value>hdfs://namenode:54310/</value> >>> >>> The two entries should match. >>> >>> I would recommend to: >>> - use netstat to check the ports (netstat -l) >>> - do the check recommended by Harsh J previously. >>> >>> N. >>> >>> >>> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: >>>> >>>> >>>> pleaseeeeeeeeeeee helpppppppppppppppppppp >>>> >>>>> From: [EMAIL PROTECTED] >>>>> To: [EMAIL PROTECTED] >>>>> Subject: RE: Important "Undefined Error" >>>>> Date: Mon, 14 May 2012 12:20:18 +0200 >>>>> >>>>> >>>>> >>>>> Hi, >>>>> I tried what you told me, but nothing worked:((( >>>>> First when I run this command:dalia@namenode:~$ host -v -t A `hostname`Output:Trying "namenode"Host namenode not found: 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My core-site.xml:<configuration><property> <name>fs.default.name</name> <!--<value>hdfs://namenode:8020</value>--> <value>hdfs://namenode:54310/</value></property></configuration> >>>>> My hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> >>>>> My Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> >>>>> My Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> <value>true</value></property><property> <name>hbase.rootdir</name> <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The host and port that the HBase master runs at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property from ZooKeeper's config zoo.cfg.The port at which the clients will connect.</description></property></configuration> >>>>> Please Help I am really disappointed I have been through all that for two weeks !!!! >>>>> >>>>> >>>>> >>>>>> From: [EMAIL PROTECTED] >>>>>> To: [EMAIL PROTECTED] >>>>>> Subject: RE: Important "Undefined Error" >>>>>> Date: Sat, 12 May 2012 23:31:49 +0530 >>>>>> >>>>>> The problem is your hbase is not able to connect to Hadoop, can you put your
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-17, 20:22
Please send the content of /etc/hosts and /etc/hostname file
try this link http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html for hadoop configuration On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > Yeasss > > Sent from my iPhone > > On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > In core-file.xml, do you have this? > > > > <configuration> > > <property> > > <name>fs.default.name</name> > > <value>hdfs://namenode:8020/hbase</value> > > </property> > > > > If you want hbase to connect to 8020 you must have hdfs listening on > > 8020 as well. > > > > > > On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy <[EMAIL PROTECTED]> > wrote: > >> Hiiii > >> > >> I have tried to make both ports the same. > >> But the prob is the hbase cannot connect to port 8020. > >> When i run nmap hostname, port 8020 wasnt with the list of open ports. > >> I have tried what harsh told me abt. > >> I used the same port he used but same error occurred. > >> Another aspect in cloudera doc it says that i have to canonical name > for the host ex: namenode.example.com as the hostname, but i didnt find > it in any tutorial. No one makes it. > >> Note that i am deploying my cluster in fully distributed mode i.e am > using 4 machines.. > >> > >> So any ideas??!! > >> > >> Sent from my iPhone > >> > >> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > >> > >>> Hi, > >>> > >>> There could be multiple issues, but it's strange to have in > hbase-site.xml > >>> > >>> <value>hdfs://namenode:9000/hbase</value> > >>> > >>> while the core-site.xml says: > >>> > >>> <value>hdfs://namenode:54310/</value> > >>> > >>> The two entries should match. > >>> > >>> I would recommend to: > >>> - use netstat to check the ports (netstat -l) > >>> - do the check recommended by Harsh J previously. > >>> > >>> N. > >>> > >>> > >>> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy < > [EMAIL PROTECTED]> wrote: > >>>> > >>>> > >>>> pleaseeeeeeeeeeee helpppppppppppppppppppp > >>>> > >>>>> From: [EMAIL PROTECTED] > >>>>> To: [EMAIL PROTECTED] > >>>>> Subject: RE: Important "Undefined Error" > >>>>> Date: Mon, 14 May 2012 12:20:18 +0200 > >>>>> > >>>>> > >>>>> > >>>>> Hi, > >>>>> I tried what you told me, but nothing worked:((( > >>>>> First when I run this command:dalia@namenode:~$ host -v -t A > `hostname`Output:Trying "namenode"Host namenode not found: > 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My > core-site.xml:<configuration><property> <name>fs.default.name</name> > <!--<value>hdfs://namenode:8020</value>--> > <value>hdfs://namenode:54310/</value></property></configuration> > >>>>> My > hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property> > <name>dfs.permissions.superusergroup</name> <value>hadoop</value></property> > >>>>> My > Mapred-site.xml<configuration><name>mapred.local.dir</name><value>/data/1/mapred/local,/data/2/mapred/local,/data/3/mapred/local</value></configuration> > >>>>> My > Hbase-site.xml<configuration><property><name>hbase.cluster.distributed</name> > <value>true</value></property><property> <name>hbase.rootdir</name> > <value>hdfs://namenode:9000/hbase</value></property><property><name>hbase.zookeeper.quorun</name> > <value>namenode</value></property><property><name>hbase.regionserver.port</name><value>60020</value><description>The > host and port that the HBase master runs > at.</description></property><property><name>dfs.replication</name><value>1</value></property><property><name>hbase.zookeeper.property.clientPort</name><value>2181</value><description>Property > from ZooKeeper's config zoo.cfg.The port at which the clients will ∞ Shashwat Shriparv
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-18, 10:48
/etc/hosts 127.0.0.1 localhost 10.0.2.3 namenode.dalia.com10.0.2.5 datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 datanode2.dalia.com /etc/hostnamenamenode.dalia.com And I am always receiving this error: INFO org.apache.hadoop.ipc.Client: Retrying connect to server: namenode/10.0.2.3:8020. Already tried 0 time(s). Note that I have already disabled the firewall and I opened the port : ufw allow 8020 But when I run : telnet 10.0.2.3 8020 => connection refused .... So the problem is that I cannot open the port..... :( Note that I have tried it with other ports as 54310 and 9000 but same error occurs... > Date: Fri, 18 May 2012 01:52:48 +0530 > Subject: Re: Important "Undefined Error" > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > > Please send the content of /etc/hosts and /etc/hostname file > > try this link > > http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html > > > for hadoop configuration > > On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > > > Yeasss > > > > Sent from my iPhone > > > > On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > > > In core-file.xml, do you have this? > > > > > > <configuration> > > > <property> > > > <name>fs.default.name</name> > > > <value>hdfs://namenode:8020/hbase</value> > > > </property> > > > > > > If you want hbase to connect to 8020 you must have hdfs listening on > > > 8020 as well. > > > > > > > > > On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy <[EMAIL PROTECTED]> > > wrote: > > >> Hiiii > > >> > > >> I have tried to make both ports the same. > > >> But the prob is the hbase cannot connect to port 8020. > > >> When i run nmap hostname, port 8020 wasnt with the list of open ports. > > >> I have tried what harsh told me abt. > > >> I used the same port he used but same error occurred. > > >> Another aspect in cloudera doc it says that i have to canonical name > > for the host ex: namenode.example.com as the hostname, but i didnt find > > it in any tutorial. No one makes it. > > >> Note that i am deploying my cluster in fully distributed mode i.e am > > using 4 machines.. > > >> > > >> So any ideas??!! > > >> > > >> Sent from my iPhone > > >> > > >> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > >> > > >>> Hi, > > >>> > > >>> There could be multiple issues, but it's strange to have in > > hbase-site.xml > > >>> > > >>> <value>hdfs://namenode:9000/hbase</value> > > >>> > > >>> while the core-site.xml says: > > >>> > > >>> <value>hdfs://namenode:54310/</value> > > >>> > > >>> The two entries should match. > > >>> > > >>> I would recommend to: > > >>> - use netstat to check the ports (netstat -l) > > >>> - do the check recommended by Harsh J previously. > > >>> > > >>> N. > > >>> > > >>> > > >>> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy < > > [EMAIL PROTECTED]> wrote: > > >>>> > > >>>> > > >>>> pleaseeeeeeeeeeee helpppppppppppppppppppp > > >>>> > > >>>>> From: [EMAIL PROTECTED] > > >>>>> To: [EMAIL PROTECTED] > > >>>>> Subject: RE: Important "Undefined Error" > > >>>>> Date: Mon, 14 May 2012 12:20:18 +0200 > > >>>>> > > >>>>> > > >>>>> > > >>>>> Hi, > > >>>>> I tried what you told me, but nothing worked:((( > > >>>>> First when I run this command:dalia@namenode:~$ host -v -t A > > `hostname`Output:Trying "namenode"Host namenode not found: > > 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My > > core-site.xml:<configuration><property> <name>fs.default.name</name> > > <!--<value>hdfs://namenode:8020</value>--> > > <value>hdfs://namenode:54310/</value></property></configuration> > > >>>>> My > > hdfs-site.xml<configuration><property><name>dfs.name.dir</name><value>/data/1/dfs/nn,/nfsmount/dfs/nn</value></property><!--<property><name>dfs.data.dir</name><value>/data/1/dfs/dn,/data/2/dfs/dn,/data/3/dfs/dn</value></property>--><property><name>dfs.datanode.max.xcievers</name><value>4096</value></property><property><name>dfs.replication</name><value>3</value></property><property>
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-18, 10:50
Hi Shashwat, I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not all in a single machine... > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > Subject: RE: Important "Undefined Error" > Date: Fri, 18 May 2012 12:48:58 +0200 > > > /etc/hosts > 127.0.0.1 localhost > 10.0.2.3 namenode.dalia.com10.0.2.5 datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 datanode2.dalia.com > /etc/hostnamenamenode.dalia.com > And I am always receiving this error: > INFO org.apache.hadoop.ipc.Client: Retrying connect to server: namenode/10.0.2.3:8020. Already tried 0 time(s). > Note that I have already disabled the firewall and I opened the port : ufw allow 8020 > But when I run : telnet 10.0.2.3 8020 => connection refused .... > So the problem is that I cannot open the port..... :( > Note that I have tried it with other ports as 54310 and 9000 but same error occurs... > > Date: Fri, 18 May 2012 01:52:48 +0530 > > Subject: Re: Important "Undefined Error" > > From: [EMAIL PROTECTED] > > To: [EMAIL PROTECTED] > > > > Please send the content of /etc/hosts and /etc/hostname file > > > > try this link > > > > http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html > > > > > > for hadoop configuration > > > > On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > > > > > Yeasss > > > > > > Sent from my iPhone > > > > > > On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > > > > > In core-file.xml, do you have this? > > > > > > > > <configuration> > > > > <property> > > > > <name>fs.default.name</name> > > > > <value>hdfs://namenode:8020/hbase</value> > > > > </property> > > > > > > > > If you want hbase to connect to 8020 you must have hdfs listening on > > > > 8020 as well. > > > > > > > > > > > > On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy <[EMAIL PROTECTED]> > > > wrote: > > > >> Hiiii > > > >> > > > >> I have tried to make both ports the same. > > > >> But the prob is the hbase cannot connect to port 8020. > > > >> When i run nmap hostname, port 8020 wasnt with the list of open ports. > > > >> I have tried what harsh told me abt. > > > >> I used the same port he used but same error occurred. > > > >> Another aspect in cloudera doc it says that i have to canonical name > > > for the host ex: namenode.example.com as the hostname, but i didnt find > > > it in any tutorial. No one makes it. > > > >> Note that i am deploying my cluster in fully distributed mode i.e am > > > using 4 machines.. > > > >> > > > >> So any ideas??!! > > > >> > > > >> Sent from my iPhone > > > >> > > > >> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > >> > > > >>> Hi, > > > >>> > > > >>> There could be multiple issues, but it's strange to have in > > > hbase-site.xml > > > >>> > > > >>> <value>hdfs://namenode:9000/hbase</value> > > > >>> > > > >>> while the core-site.xml says: > > > >>> > > > >>> <value>hdfs://namenode:54310/</value> > > > >>> > > > >>> The two entries should match. > > > >>> > > > >>> I would recommend to: > > > >>> - use netstat to check the ports (netstat -l) > > > >>> - do the check recommended by Harsh J previously. > > > >>> > > > >>> N. > > > >>> > > > >>> > > > >>> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy < > > > [EMAIL PROTECTED]> wrote: > > > >>>> > > > >>>> > > > >>>> pleaseeeeeeeeeeee helpppppppppppppppppppp > > > >>>> > > > >>>>> From: [EMAIL PROTECTED] > > > >>>>> To: [EMAIL PROTECTED] > > > >>>>> Subject: RE: Important "Undefined Error" > > > >>>>> Date: Mon, 14 May 2012 12:20:18 +0200 > > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>> Hi, > > > >>>>> I tried what you told me, but nothing worked:((( > > > >>>>> First when I run this command:dalia@namenode:~$ host -v -t A > > > `hostname`Output:Trying "namenode"Host namenode not found: > > > 3(NXDOMAIN)Received 101 bytes from 10.0.2.1#53 in 13 ms My > > > core-site.xml:<configuration><property> <name>fs.default.name</name>
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-18, 11:40
See the hosts file and hostname file looks fine... add this setting to all
your slaves and hosts. Is it cumplsory to use CDH3u3 dist...? dont you download from apache. if you want i can send you the preconfigured dist of apache... did you do ssh to aal the machine and added the public key of master to all slaves?? just remove localhost anywhere in conf files of hadoop and hbase... On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > > Hi Shashwat, > I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not all > in a single machine... > > > From: [EMAIL PROTECTED] > > To: [EMAIL PROTECTED] > > Subject: RE: Important "Undefined Error" > > Date: Fri, 18 May 2012 12:48:58 +0200 > > > > > > /etc/hosts > > 127.0.0.1 localhost > > 10.0.2.3 namenode.dalia.com10.0.2.5 > datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 > datanode2.dalia.com > > /etc/hostnamenamenode.dalia.com > > And I am always receiving this error: > > INFO org.apache.hadoop.ipc.Client: Retrying connect to server: namenode/ > 10.0.2.3:8020. Already tried 0 time(s). > > Note that I have already disabled the firewall and I opened the port : > ufw allow 8020 > > But when I run : telnet 10.0.2.3 8020 => connection refused .... > > So the problem is that I cannot open the port..... :( > > Note that I have tried it with other ports as 54310 and 9000 but same > error occurs... > > > Date: Fri, 18 May 2012 01:52:48 +0530 > > > Subject: Re: Important "Undefined Error" > > > From: [EMAIL PROTECTED] > > > To: [EMAIL PROTECTED] > > > > > > Please send the content of /etc/hosts and /etc/hostname file > > > > > > try this link > > > > > > > http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html > > > > > > > > > for hadoop configuration > > > > > > On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy < > [EMAIL PROTECTED]>wrote: > > > > > > > Yeasss > > > > > > > > Sent from my iPhone > > > > > > > > On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > > > > > > > In core-file.xml, do you have this? > > > > > > > > > > <configuration> > > > > > <property> > > > > > <name>fs.default.name</name> > > > > > <value>hdfs://namenode:8020/hbase</value> > > > > > </property> > > > > > > > > > > If you want hbase to connect to 8020 you must have hdfs listening > on > > > > > 8020 as well. > > > > > > > > > > > > > > > On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy < > [EMAIL PROTECTED]> > > > > wrote: > > > > >> Hiiii > > > > >> > > > > >> I have tried to make both ports the same. > > > > >> But the prob is the hbase cannot connect to port 8020. > > > > >> When i run nmap hostname, port 8020 wasnt with the list of open > ports. > > > > >> I have tried what harsh told me abt. > > > > >> I used the same port he used but same error occurred. > > > > >> Another aspect in cloudera doc it says that i have to canonical > name > > > > for the host ex: namenode.example.com as the hostname, but i didnt > find > > > > it in any tutorial. No one makes it. > > > > >> Note that i am deploying my cluster in fully distributed mode i.e > am > > > > using 4 machines.. > > > > >> > > > > >> So any ideas??!! > > > > >> > > > > >> Sent from my iPhone > > > > >> > > > > >> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > > > > >> > > > > >>> Hi, > > > > >>> > > > > >>> There could be multiple issues, but it's strange to have in > > > > hbase-site.xml > > > > >>> > > > > >>> <value>hdfs://namenode:9000/hbase</value> > > > > >>> > > > > >>> while the core-site.xml says: > > > > >>> > > > > >>> <value>hdfs://namenode:54310/</value> > > > > >>> > > > > >>> The two entries should match. > > > > >>> > > > > >>> I would recommend to: > > > > >>> - use netstat to check the ports (netstat -l) > > > > >>> - do the check recommended by Harsh J previously. > > > > >>> > > > > >>> N. > > > > >>> > > > > >>> > > > > >>> On Mon, May 14, 2012 at 3:21 PM, Dalia Sobhy < > > > > [EMAIL PROTECTED]> wrote: ∞ Shashwat Shriparv
-
Re: Important "Undefined Error"Dalia Sobhy 2012-05-18, 12:22
I did all what u said.
Yes I have to use it bec I already tried my code but on a standalone machine for cdh3u3. But am mad from it its been now 20 days since I started deploying it and I only have one week to finish it bec I am sticked with deadlines. Bas I think it wud be great if you send me your preconfigured dist of apache.. Sent from my iPad On May 18, 2012, at 1:41 PM, "shashwat shriparv" <[EMAIL PROTECTED]> wrote: > See the hosts file and hostname file looks fine... add this setting to all > your slaves and hosts. > > Is it cumplsory to use CDH3u3 dist...? dont you download from apache. if > you want i can send you the preconfigured dist of apache... > > did you do ssh to aal the machine and added the public key of master to all > slaves?? just remove localhost anywhere in conf files of hadoop and hbase... > > On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > >> >> Hi Shashwat, >> I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not all >> in a single machine... >> >>> From: [EMAIL PROTECTED] >>> To: [EMAIL PROTECTED] >>> Subject: RE: Important "Undefined Error" >>> Date: Fri, 18 May 2012 12:48:58 +0200 >>> >>> >>> /etc/hosts >>> 127.0.0.1 localhost >>> 10.0.2.3 namenode.dalia.com10.0.2.5 >> datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 >> datanode2.dalia.com >>> /etc/hostnamenamenode.dalia.com >>> And I am always receiving this error: >>> INFO org.apache.hadoop.ipc.Client: Retrying connect to server: namenode/ >> 10.0.2.3:8020. Already tried 0 time(s). >>> Note that I have already disabled the firewall and I opened the port : >> ufw allow 8020 >>> But when I run : telnet 10.0.2.3 8020 => connection refused .... >>> So the problem is that I cannot open the port..... :( >>> Note that I have tried it with other ports as 54310 and 9000 but same >> error occurs... >>>> Date: Fri, 18 May 2012 01:52:48 +0530 >>>> Subject: Re: Important "Undefined Error" >>>> From: [EMAIL PROTECTED] >>>> To: [EMAIL PROTECTED] >>>> >>>> Please send the content of /etc/hosts and /etc/hostname file >>>> >>>> try this link >>>> >>>> >> http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html >>>> >>>> >>>> for hadoop configuration >>>> >>>> On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy < >> [EMAIL PROTECTED]>wrote: >>>> >>>>> Yeasss >>>>> >>>>> Sent from my iPhone >>>>> >>>>> On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: >>>>> >>>>>> In core-file.xml, do you have this? >>>>>> >>>>>> <configuration> >>>>>> <property> >>>>>> <name>fs.default.name</name> >>>>>> <value>hdfs://namenode:8020/hbase</value> >>>>>> </property> >>>>>> >>>>>> If you want hbase to connect to 8020 you must have hdfs listening >> on >>>>>> 8020 as well. >>>>>> >>>>>> >>>>>> On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy < >> [EMAIL PROTECTED]> >>>>> wrote: >>>>>>> Hiiii >>>>>>> >>>>>>> I have tried to make both ports the same. >>>>>>> But the prob is the hbase cannot connect to port 8020. >>>>>>> When i run nmap hostname, port 8020 wasnt with the list of open >> ports. >>>>>>> I have tried what harsh told me abt. >>>>>>> I used the same port he used but same error occurred. >>>>>>> Another aspect in cloudera doc it says that i have to canonical >> name >>>>> for the host ex: namenode.example.com as the hostname, but i didnt >> find >>>>> it in any tutorial. No one makes it. >>>>>>> Note that i am deploying my cluster in fully distributed mode i.e >> am >>>>> using 4 machines.. >>>>>>> >>>>>>> So any ideas??!! >>>>>>> >>>>>>> Sent from my iPhone >>>>>>> >>>>>>> On 2012-05-14, at 4:07 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: >>>>>>> >>>>>>>> Hi, >>>>>>>> >>>>>>>> There could be multiple issues, but it's strange to have in >>>>> hbase-site.xml >>>>>>>> >>>>>>>> <value>hdfs://namenode:9000/hbase</value> >>>>>>>> >>>>>>>> while the core-site.xml says: >>>>>>>> >>>>>>>> <value>hdfs://namenode:54310/</value>
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-18, 20:05
Here is the link from which you can download the preconfigured hadoop/hbase
,,,, just keep in mind please change the configuration according to your machine and hostnames.. *http://dl.dropbox.com/u/19454506/Hadoop_HHH_Working.zip* * * * * The video link i sent you its not just for the cluster on same pc if you follow the steps you can configure a cluster on using physical pc. and please let us know what code you are trying?? and what ever settings you have for the master node in hosts file just copy the sam to the slaves also... Last option if you are not able to do, let me take remote connection to your pc i will do it.. but i dont think i will be needed :) On Fri, May 18, 2012 at 5:52 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > I did all what u said. > > Yes I have to use it bec I already tried my code but on a standalone > machine for cdh3u3. > > But am mad from it its been now 20 days since I started deploying it and I > only have one week to finish it bec I am sticked with deadlines. > > Bas I think it wud be great if you send me your preconfigured dist of > apache.. > > Sent from my iPad > > On May 18, 2012, at 1:41 PM, "shashwat shriparv" < > [EMAIL PROTECTED]> wrote: > > > See the hosts file and hostname file looks fine... add this setting to > all > > your slaves and hosts. > > > > Is it cumplsory to use CDH3u3 dist...? dont you download from apache. if > > you want i can send you the preconfigured dist of apache... > > > > did you do ssh to aal the machine and added the public key of master to > all > > slaves?? just remove localhost anywhere in conf files of hadoop and > hbase... > > > > On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy <[EMAIL PROTECTED] > >wrote: > > > >> > >> Hi Shashwat, > >> I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not > all > >> in a single machine... > >> > >>> From: [EMAIL PROTECTED] > >>> To: [EMAIL PROTECTED] > >>> Subject: RE: Important "Undefined Error" > >>> Date: Fri, 18 May 2012 12:48:58 +0200 > >>> > >>> > >>> /etc/hosts > >>> 127.0.0.1 localhost > >>> 10.0.2.3 namenode.dalia.com10.0.2.5 > >> datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 > >> datanode2.dalia.com > >>> /etc/hostnamenamenode.dalia.com > >>> And I am always receiving this error: > >>> INFO org.apache.hadoop.ipc.Client: Retrying connect to server: > namenode/ > >> 10.0.2.3:8020. Already tried 0 time(s). > >>> Note that I have already disabled the firewall and I opened the port : > >> ufw allow 8020 > >>> But when I run : telnet 10.0.2.3 8020 => connection refused .... > >>> So the problem is that I cannot open the port..... :( > >>> Note that I have tried it with other ports as 54310 and 9000 but same > >> error occurs... > >>>> Date: Fri, 18 May 2012 01:52:48 +0530 > >>>> Subject: Re: Important "Undefined Error" > >>>> From: [EMAIL PROTECTED] > >>>> To: [EMAIL PROTECTED] > >>>> > >>>> Please send the content of /etc/hosts and /etc/hostname file > >>>> > >>>> try this link > >>>> > >>>> > >> > http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html > >>>> > >>>> > >>>> for hadoop configuration > >>>> > >>>> On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy < > >> [EMAIL PROTECTED]>wrote: > >>>> > >>>>> Yeasss > >>>>> > >>>>> Sent from my iPhone > >>>>> > >>>>> On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote: > >>>>> > >>>>>> In core-file.xml, do you have this? > >>>>>> > >>>>>> <configuration> > >>>>>> <property> > >>>>>> <name>fs.default.name</name> > >>>>>> <value>hdfs://namenode:8020/hbase</value> > >>>>>> </property> > >>>>>> > >>>>>> If you want hbase to connect to 8020 you must have hdfs listening > >> on > >>>>>> 8020 as well. > >>>>>> > >>>>>> > >>>>>> On Mon, May 14, 2012 at 5:17 PM, Dalia Sobhy < > >> [EMAIL PROTECTED]> > >>>>> wrote: > >>>>>>> Hiiii > >>>>>>> > >>>>>>> I have tried to make both ports the same. > >>>>>>> But the prob is the hbase cannot connect to port 8020. ∞ Shashwat Shriparv
-
RE: Important "Undefined Error"Dalia Sobhy 2012-05-19, 19:33
Hiiii shashwat, Thanks for sharing your config files. But it seems that they are for pseudodistributed mode. I am using fully distributed mode on 4 PCs (one master and three slaves). Thus, it seems that these configs cannot work with mine... Thanks, > Date: Sat, 19 May 2012 01:35:09 +0530 > Subject: Re: Important "Undefined Error" > From: [EMAIL PROTECTED] > To: [EMAIL PROTECTED] > > Here is the link from which you can download the preconfigured hadoop/hbase > ,,,, just keep in mind please change the configuration according to your > machine and hostnames.. > > *http://dl.dropbox.com/u/19454506/Hadoop_HHH_Working.zip* > * > * > * > * > The video link i sent you its not just for the cluster on same pc if you > follow the steps you can configure a cluster on using physical pc. > > and please let us know what code you are trying?? > > and what ever settings you have for the master node in hosts file just copy > the sam to the slaves also... > > Last option if you are not able to do, let me take remote connection to > your pc i will do it.. but i dont think i will be needed :) > > On Fri, May 18, 2012 at 5:52 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: > > > I did all what u said. > > > > Yes I have to use it bec I already tried my code but on a standalone > > machine for cdh3u3. > > > > But am mad from it its been now 20 days since I started deploying it and I > > only have one week to finish it bec I am sticked with deadlines. > > > > Bas I think it wud be great if you send me your preconfigured dist of > > apache.. > > > > Sent from my iPad > > > > On May 18, 2012, at 1:41 PM, "shashwat shriparv" < > > [EMAIL PROTECTED]> wrote: > > > > > See the hosts file and hostname file looks fine... add this setting to > > all > > > your slaves and hosts. > > > > > > Is it cumplsory to use CDH3u3 dist...? dont you download from apache. if > > > you want i can send you the preconfigured dist of apache... > > > > > > did you do ssh to aal the machine and added the public key of master to > > all > > > slaves?? just remove localhost anywhere in conf files of hadoop and > > hbase... > > > > > > On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy <[EMAIL PROTECTED] > > >wrote: > > > > > >> > > >> Hi Shashwat, > > >> I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not > > all > > >> in a single machine... > > >> > > >>> From: [EMAIL PROTECTED] > > >>> To: [EMAIL PROTECTED] > > >>> Subject: RE: Important "Undefined Error" > > >>> Date: Fri, 18 May 2012 12:48:58 +0200 > > >>> > > >>> > > >>> /etc/hosts > > >>> 127.0.0.1 localhost > > >>> 10.0.2.3 namenode.dalia.com10.0.2.5 > > >> datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 > > >> datanode2.dalia.com > > >>> /etc/hostnamenamenode.dalia.com > > >>> And I am always receiving this error: > > >>> INFO org.apache.hadoop.ipc.Client: Retrying connect to server: > > namenode/ > > >> 10.0.2.3:8020. Already tried 0 time(s). > > >>> Note that I have already disabled the firewall and I opened the port : > > >> ufw allow 8020 > > >>> But when I run : telnet 10.0.2.3 8020 => connection refused .... > > >>> So the problem is that I cannot open the port..... :( > > >>> Note that I have tried it with other ports as 54310 and 9000 but same > > >> error occurs... > > >>>> Date: Fri, 18 May 2012 01:52:48 +0530 > > >>>> Subject: Re: Important "Undefined Error" > > >>>> From: [EMAIL PROTECTED] > > >>>> To: [EMAIL PROTECTED] > > >>>> > > >>>> Please send the content of /etc/hosts and /etc/hostname file > > >>>> > > >>>> try this link > > >>>> > > >>>> > > >> > > http://helpmetocode.blogspot.in/2012/05/hadoop-fully-distributed-cluster.html > > >>>> > > >>>> > > >>>> for hadoop configuration > > >>>> > > >>>> On Mon, May 14, 2012 at 10:15 PM, Dalia Sobhy < > > >> [EMAIL PROTECTED]>wrote: > > >>>> > > >>>>> Yeasss > > >>>>> > > >>>>> Sent from my iPhone > > >>>>> > > >>>>> On 2012-05-14, at 5:28 PM, "N Keywal" <[EMAIL PROTECTED]> wrote:
-
Re: Important "Undefined Error"Mohammad Tariq 2012-05-20, 10:16
Hi Dalia,
Which version of hadoop and hbase are you using??Please add hadoop-core-*.jar from your HADOOP_HOME and commons-collections-3.2.1.jar from your HADOOP_HOME/lib directory into your HBASE_HOME/lib directory and see if it works for you. Regards, Mohammad Tariq On Sun, May 20, 2012 at 1:03 AM, Dalia Sobhy <[EMAIL PROTECTED]> wrote: > > Hiiii shashwat, > > Thanks for sharing your config files. But it seems that they are for pseudodistributed mode. I am using fully distributed mode on 4 PCs (one master and three slaves). Thus, it seems that these configs cannot work with mine... > > Thanks, > >> Date: Sat, 19 May 2012 01:35:09 +0530 >> Subject: Re: Important "Undefined Error" >> From: [EMAIL PROTECTED] >> To: [EMAIL PROTECTED] >> >> Here is the link from which you can download the preconfigured hadoop/hbase >> ,,,, just keep in mind please change the configuration according to your >> machine and hostnames.. >> >> *http://dl.dropbox.com/u/19454506/Hadoop_HHH_Working.zip* >> * >> * >> * >> * >> The video link i sent you its not just for the cluster on same pc if you >> follow the steps you can configure a cluster on using physical pc. >> >> and please let us know what code you are trying?? >> >> and what ever settings you have for the master node in hosts file just copy >> the sam to the slaves also... >> >> Last option if you are not able to do, let me take remote connection to >> your pc i will do it.. but i dont think i will be needed :) >> >> On Fri, May 18, 2012 at 5:52 PM, Dalia Sobhy <[EMAIL PROTECTED]>wrote: >> >> > I did all what u said. >> > >> > Yes I have to use it bec I already tried my code but on a standalone >> > machine for cdh3u3. >> > >> > But am mad from it its been now 20 days since I started deploying it and I >> > only have one week to finish it bec I am sticked with deadlines. >> > >> > Bas I think it wud be great if you send me your preconfigured dist of >> > apache.. >> > >> > Sent from my iPad >> > >> > On May 18, 2012, at 1:41 PM, "shashwat shriparv" < >> > [EMAIL PROTECTED]> wrote: >> > >> > > See the hosts file and hostname file looks fine... add this setting to >> > all >> > > your slaves and hosts. >> > > >> > > Is it cumplsory to use CDH3u3 dist...? dont you download from apache. if >> > > you want i can send you the preconfigured dist of apache... >> > > >> > > did you do ssh to aal the machine and added the public key of master to >> > all >> > > slaves?? just remove localhost anywhere in conf files of hadoop and >> > hbase... >> > > >> > > On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy <[EMAIL PROTECTED] >> > >wrote: >> > > >> > >> >> > >> Hi Shashwat, >> > >> I am deploying my cluster on 4 PCs, one master and 3 slave nodes, not >> > all >> > >> in a single machine... >> > >> >> > >>> From: [EMAIL PROTECTED] >> > >>> To: [EMAIL PROTECTED] >> > >>> Subject: RE: Important "Undefined Error" >> > >>> Date: Fri, 18 May 2012 12:48:58 +0200 >> > >>> >> > >>> >> > >>> /etc/hosts >> > >>> 127.0.0.1 localhost >> > >>> 10.0.2.3 namenode.dalia.com10.0.2.5 >> > >> datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 >> > >> datanode2.dalia.com >> > >>> /etc/hostnamenamenode.dalia.com >> > >>> And I am always receiving this error: >> > >>> INFO org.apache.hadoop.ipc.Client: Retrying connect to server: >> > namenode/ >> > >> 10.0.2.3:8020. Already tried 0 time(s). >> > >>> Note that I have already disabled the firewall and I opened the port : >> > >> ufw allow 8020 >> > >>> But when I run : telnet 10.0.2.3 8020 => connection refused .... >> > >>> So the problem is that I cannot open the port..... :( >> > >>> Note that I have tried it with other ports as 54310 and 9000 but same >> > >> error occurs... >> > >>>> Date: Fri, 18 May 2012 01:52:48 +0530 >> > >>>> Subject: Re: Important "Undefined Error" >> > >>>> From: [EMAIL PROTECTED] >> > >>>> To: [EMAIL PROTECTED] >> > >>>> >> > >>>> Please send the content of /etc/hosts and /etc/hostname file
-
Re: Important "Undefined Error"shashwat shriparv 2012-05-20, 13:33
Hey with few changes you can meke it fully distributed..
On Sun, May 20, 2012 at 3:46 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote: > Hi Dalia, > Which version of hadoop and hbase are you using??Please add > hadoop-core-*.jar from your HADOOP_HOME and > commons-collections-3.2.1.jar from your HADOOP_HOME/lib directory into > your HBASE_HOME/lib directory and see if it works for you. > > Regards, > Mohammad Tariq > > > On Sun, May 20, 2012 at 1:03 AM, Dalia Sobhy <[EMAIL PROTECTED]> > wrote: > > > > Hiiii shashwat, > > > > Thanks for sharing your config files. But it seems that they are for > pseudodistributed mode. I am using fully distributed mode on 4 PCs (one > master and three slaves). Thus, it seems that these configs cannot work > with mine... > > > > Thanks, > > > >> Date: Sat, 19 May 2012 01:35:09 +0530 > >> Subject: Re: Important "Undefined Error" > >> From: [EMAIL PROTECTED] > >> To: [EMAIL PROTECTED] > >> > >> Here is the link from which you can download the preconfigured > hadoop/hbase > >> ,,,, just keep in mind please change the configuration according to your > >> machine and hostnames.. > >> > >> *http://dl.dropbox.com/u/19454506/Hadoop_HHH_Working.zip* > >> * > >> * > >> * > >> * > >> The video link i sent you its not just for the cluster on same pc if you > >> follow the steps you can configure a cluster on using physical pc. > >> > >> and please let us know what code you are trying?? > >> > >> and what ever settings you have for the master node in hosts file just > copy > >> the sam to the slaves also... > >> > >> Last option if you are not able to do, let me take remote connection to > >> your pc i will do it.. but i dont think i will be needed :) > >> > >> On Fri, May 18, 2012 at 5:52 PM, Dalia Sobhy < > [EMAIL PROTECTED]>wrote: > >> > >> > I did all what u said. > >> > > >> > Yes I have to use it bec I already tried my code but on a standalone > >> > machine for cdh3u3. > >> > > >> > But am mad from it its been now 20 days since I started deploying it > and I > >> > only have one week to finish it bec I am sticked with deadlines. > >> > > >> > Bas I think it wud be great if you send me your preconfigured dist of > >> > apache.. > >> > > >> > Sent from my iPad > >> > > >> > On May 18, 2012, at 1:41 PM, "shashwat shriparv" < > >> > [EMAIL PROTECTED]> wrote: > >> > > >> > > See the hosts file and hostname file looks fine... add this setting > to > >> > all > >> > > your slaves and hosts. > >> > > > >> > > Is it cumplsory to use CDH3u3 dist...? dont you download from > apache. if > >> > > you want i can send you the preconfigured dist of apache... > >> > > > >> > > did you do ssh to aal the machine and added the public key of > master to > >> > all > >> > > slaves?? just remove localhost anywhere in conf files of hadoop and > >> > hbase... > >> > > > >> > > On Fri, May 18, 2012 at 4:20 PM, Dalia Sobhy < > [EMAIL PROTECTED] > >> > >wrote: > >> > > > >> > >> > >> > >> Hi Shashwat, > >> > >> I am deploying my cluster on 4 PCs, one master and 3 slave nodes, > not > >> > all > >> > >> in a single machine... > >> > >> > >> > >>> From: [EMAIL PROTECTED] > >> > >>> To: [EMAIL PROTECTED] > >> > >>> Subject: RE: Important "Undefined Error" > >> > >>> Date: Fri, 18 May 2012 12:48:58 +0200 > >> > >>> > >> > >>> > >> > >>> /etc/hosts > >> > >>> 127.0.0.1 localhost > >> > >>> 10.0.2.3 namenode.dalia.com10.0.2.5 > >> > >> datanode3.dalia.com10.0.2.6 datanode1.dalia.com10.0.2.42 > >> > >> datanode2.dalia.com > >> > >>> /etc/hostnamenamenode.dalia.com > >> > >>> And I am always receiving this error: > >> > >>> INFO org.apache.hadoop.ipc.Client: Retrying connect to server: > >> > namenode/ > >> > >> 10.0.2.3:8020. Already tried 0 time(s). > >> > >>> Note that I have already disabled the firewall and I opened the > port : > >> > >> ufw allow 8020 > >> > >>> But when I run : telnet 10.0.2.3 8020 => connection refused .... > >> > >>> So the problem is that I cannot open the port..... :( ∞ Shashwat Shriparv |