MapReduce, mail # user - namenode not in tmp, doesn't start

namenode not in tmp, doesn't start

Vinutha Magal Shreenath 2012-10-12, 07:30

Hello,

I'm just starting out with Hadoop.
As generally advised, I configured namenode to a directory other than /tmp.
When I do this, and try start-all.sh, I get the exception below.
Formatting namenode does not help.
Any suggestions?

Thanks in advance.

Regards,
Vinutha

2012-10-12 12:40:23,530 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
java.io.IOException: NameNode is not formatted.
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
2012-10-12 12:40:23,531 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: NameNode is not formatted.
at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)

Re: namenode not in tmp, doesn't start

Harsh J 2012-10-12, 15:33

> Formatting namenode does not help.

Did you format your namenode already? You've lost your current fsimage
in that case. Format wipes it - so never format after the first time,
ever.

Or otherwise, perhaps your problem may be defined like this:

- You used to use /tmp/hadoop-*/dfs/name
- You reconfigured to use a non-tmp location
- NameNode won't start now.

If that is the case, you have a chance left if you haven't rebooted
the machine yet. Go to the /tmp location of your dfs.name.dir location
and copy over the directories and files (current/, image/,
previous.checkpoint/, etc.) to under the new location. Start your
NameNode now regularly, should start up.

On Fri, Oct 12, 2012 at 1:00 PM, Vinutha Magal Shreenath
<[EMAIL PROTECTED]> wrote:
> Hello,
>
> I'm just starting out with Hadoop.
> As generally advised, I configured namenode to a directory other than /tmp.
> When I do this, and try start-all.sh, I get the exception below.
> Formatting namenode does not help.
> Any suggestions?
>
> Thanks in advance.
>
> Regards,
> Vinutha
>
> 2012-10-12 12:40:23,530 ERROR
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem
> initialization failed.
> java.io.IOException: NameNode is not formatted.
> at
> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
> 2012-10-12 12:40:23,531 ERROR
> org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException:
> NameNode is not formatted.
> at
> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
> at
> org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
>

--
Harsh J

Re: namenode not in tmp, doesn't start

Abhishek 2012-10-12, 14:48

Hi Vinutha,

Your name node is not formatted.

Did you try this

Hadoop namenode -format

What are permissions on your

dfs.name.dir directory ?

Regards
Abhi

Sent from my iPhone

On Oct 12, 2012, at 3:30 AM, Vinutha Magal Shreenath <[EMAIL PROTECTED]> wrote:

> Hello,
>
> I'm just starting out with Hadoop.
> As generally advised, I configured namenode to a directory other than /tmp.
> When I do this, and try start-all.sh, I get the exception below.
> Formatting namenode does not help.
> Any suggestions?
>
> Thanks in advance.
>
> Regards,
> Vinutha
>
> 2012-10-12 12:40:23,530 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
> java.io.IOException: NameNode is not formatted.
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
> at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
> 2012-10-12 12:40:23,531 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: NameNode is not formatted.
> at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:330)
> at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
> at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:362)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:496)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1288)
>