-Apache Hadoop 2.2 install and setup help
Pastrana, Rodrigo 2013-10-31, 18:18
Having a hard time setting-up a single node hadoop 2.2 on Ubuntu 12.04. I'm following this doc: http://hadoop.apache.org/docs/current2/hadoop-project-dist/hadoop-common/SingleCluster.html ( eventhough it is versioned 2.1.1-beta ).
I've setup a dedicated hduser, localhost no pass ssh is setup, JAVA_HOME properly set, Pv6 disabled, and hadoop-2.2.0.tar.gz<http://apache.mirrors.tds.net/hadoop/common/hadoop-2.2.0/hadoop-2.2.0.tar.gz> extracted to /home/hduser/yarn/Hadoop-2.2.0.
The doc starts out with the assumption that hadoop-common/hadoop-hdfs are installed. (I'm assuming that means simply extracting the Hadoop-2.2.tar file since I couldn't find a stand-alone Hadoop-common or Hadoop-hdfs package).
It assumes the following (seems like common sense, but I'll display what I did in case I screwed that up)
$HADOOP_COMMON_HOME - /home/hduser/yarn/Hadoop-2.2.0
$HADOOP_HDFS_HOME - /home/hduser/yarn/Hadoop-2.2.0
$HADOO_MAPRED_HOME - /home/hduser/yarn/Hadoop-2.2.0
$HADOOP_YARN_HOME - /home/hduser/yarn/Hadoop-2.2.0
$HADOOP_CONF_DIR - /home/hduser/yarn/Hadoop-2.2.0/etc/hadoop
untar hadoop mapreduce tarball - hmmm I assume this is the Hadoop-2.2.0 tar file
HDFS should be running. - I'm sure this is trivial to do, but can anybody point out how to do this? In previous versions the Hfile system had be formatted, but the command has apparently been deprecated.
"bin/Hadoop namenode -format" - DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it.
sbin/yarn-daemon.sh start resourcemanager - no visible errors
sbin/yarn-daemon.sh start nodemanager - no visible errors
I'm assuming that the previous two commands don't start every component. I tried the following: sbin/Hadoop-daemon.sh start namenode
But I see the following error:
Java.io.IOException: NameNode is not formatted.
Thanks in advance to anybody that can help me get the single node up and running. Thanks.
The information contained in this e-mail message is intended only
for the personal and confidential use of the recipient(s) named
above. This message may be an attorney-client communication and/or
work product and as such is privileged and confidential. If the
reader of this message is not the intended recipient or an agent
responsible for delivering it to the intended recipient, you are
hereby notified that you have received this document in error and
that any review, dissemination, distribution, or copying of this
message is strictly prohibited. If you have received this
communication in error, please notify us immediately by e-mail, and
delete the original message.