Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> HADOOP UPGRADE ISSUE


+
yogesh dhari 2012-11-22, 06:53
+
Uma Maheswara Rao G 2012-11-22, 07:05
+
yogesh dhari 2012-11-22, 08:19
Copy link to this message
-
Re: HADOOP UPGRADE ISSUE
If your UI is already up, then NN is already functional. The UI merely
shows that your upgrade is done but has not been manually finalized by you
(leaving it open for a rollback if needed).

You could try a simple "hadoop fs -ls /" to see if NN is functional, run
some other regular job based tests of yours, and then finalize the new
format by issuing "hadoop dfsadmin -finalizeUpgrade" to make the upgrade
permanent (no rollback possible after this).
On Thu, Nov 22, 2012 at 1:49 PM, yogesh dhari <[EMAIL PROTECTED]> wrote:

>  Thanks Uma,
>
> I used command
> hadoop namenode -upgrade and its started well but got stuck at one point.
>
> 12/11/22 13:06:19 INFO mortbay.log: Started
> SelectChannelConnector@localhost:50070
> 12/11/22 13:06:19 INFO namenode.NameNode: Web-server up at: localhost:50070
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server Responder: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server listener on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 0 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 1 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 2 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 3 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 4 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 5 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 6 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 7 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 8 on 9000: starting
> 12/11/22 13:06:19 INFO ipc.Server: IPC Server handler 9 on 9000: starting
>
> from this point its not showing any progress for past 30 + mins...
>
>
> and Web ui shows
>
> NameNode 'localhost:9000'  Started: Thu Nov 22 13:06:17 IST 2012 Version: 1.0.4,
> r1393290  Compiled: Wed Oct 3 05:13:58 UTC 2012 by hortonfo  Upgrades: Upgrade
> for version -32 has been completed. Upgrade is not finalized.
>
> Please suggest
>
> Regards
> Yogesh Kumar
>
>
>
>
> ------------------------------
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
> Subject: RE: HADOOP UPGRADE ISSUE
> Date: Thu, 22 Nov 2012 07:05:51 +0000
>
>
>  start-all.sh will not carry any arguments to pass to nodes.
> Start with start-dfs.sh
> or start directly namenode with upgrade option. ./hadoop namenode -upgrade
>
> Regards,
> Uma
>  ------------------------------
> *From:* yogesh dhari [[EMAIL PROTECTED]]
> *Sent:* Thursday, November 22, 2012 12:23 PM
> *To:* hadoop helpforoum
> *Subject:* HADOOP UPGRADE ISSUE
>
>   Hi All,
>
> I am trying upgrading apache *hadoop-0.20.2 to hadoop-1.0.4*.
> I have give same dfs.name.dir, etc as same in hadoop-1.0.4' conf files as
> were in hadoop-0.20.2.
> Now I am starting dfs n mapred using
>
> *start-all.sh -upgrade*
>
> but *namenode *and *datanode* fail to run.
>
> 1) *Namenode's *logs shows::
>
> ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem
> initialization failed.
> java.io.IOException:
> File system image contains an old layout version -18.
> An upgrade to version -32 is required.
> Please restart NameNode with -upgrade option.
> .
> .
> ERROR org.apache.hadoop.hdfs.server.namenode.NameNode:
> java.io.IOException:
> File system image contains an old layout version -18.
> An upgrade to version -32 is required.
> Please restart NameNode with -upgrade option.
>
>
> 2)* Datanode's* logs shows::
>
> WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Invalid directory in
> dfs.data.dir: Incorrect permission for /opt/hadoop_newdata_dirr, expected:
> rwxr-xr-x, while actual: rwxrwxrwx
> ****(  how these file permission showing warnings)*****
>
> 2012-11-22 12:05:21,157 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: All directories in
> dfs.data.dir are invalid.
>
> Please suggest
>
> Thanks & Regards
> Yogesh Kumar
>
>
>
--
Harsh J
+
yogesh dhari 2012-11-22, 09:30
+
Harsh J 2012-11-22, 09:48
+
yogesh dhari 2012-11-22, 10:35
+
Harsh J 2012-11-22, 13:14