Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Re: Issue on formating the file system


Copy link to this message
-
Re: Issue on formating the file system
Thanks Harsh.

I figured out the issue. Added following environment variables :

=====================================
export HADOOP_DEV_HOME=`pwd`
export HADOOP_MAPRED_HOME=${HADOOP_DEV_HOME}
export HADOOP_COMMON_HOME=${HADOOP_DEV_HOME}
export HADOOP_HDFS_HOME=${HADOOP_DEV_HOME}
export YARN_HOME=${HADOOP_DEV_HOME}
export HADOOP_CONF_DIR=${HADOOP_DEV_HOME}/conf/
export YARN_CONF_DIR=~${HADOOP_DEV_HOME}/conf/

 Then the format is working.
----- Original Message -----
From: Harsh J <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]; Hai Huang <[EMAIL PROTECTED]>
Cc:
Sent: Friday, February 3, 2012 1:04:39 AM
Subject: Re: Issue on formating the file system

What is your dfs.namenode.name.dir configured to, in hdfs-site.xml?

On Fri, Feb 3, 2012 at 10:57 AM, Hai Huang <[EMAIL PROTECTED]> wrote:
> I am trying to format a filesystem (below) following the online doc
>
>
> --------------------------------------------
>  $ bin/hadoop namenode -format
> --------------------------------------------
>
> I got the following error message:
>
> --------------------------------------------
> DEPRECATED: Use of this script to execute hdfs command is deprecated.
> Instead use the hdfs command for it.
> ....
>
> Formatting using clusterid: CID-22948dd2-0f38-4ecb-a5ff-2d2e1d24285d
> 12/02/02 21:17:26 ERROR namenode.NameNode: Exception in namenode join
> java.lang.IllegalArgumentException: URI has an authority component
>         at java.io.File.<init>(File.java:385)
>         at org.apache.hadoop.hdfs.server.namenode.NNStorage.getStorageDirectory(NNStorage.java:310)
>         at org.apache.hadoop.hdfs.server.namenode.FSEditLog.init(FSEditLog.java:178)
>         at org.apache.hadoop.hdfs.server.namenode.FSEditLog.<init>(FSEditLog.java:155)
>         at org.apache.hadoop.hdfs.server.namenode.FSImage.<init>(FSImage.java:125)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:605)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:733)
>         at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:800)
> 12/02/02 21:17:26 INFO namenode.NameNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down NameNode at localhost.localdomain/127.0.0.1
> ************************************************************/
> --------------------------------------------
>
> Does anyone know this issue?
>
> I am using the hadoop built myself . The command ( $ bin/hadoop namenode -format)  is issed under the directory
>
> /hadoop-common/hadoop-dist/target/hadoop-0.24.0-SNAPSHOT
>
>
> Thanks,
>
> Haifegng

--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB