Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Re: HDFS upgrade problem of fsImage


Copy link to this message
-
Re: HDFS upgrade problem of fsImage
Thanks Joshi,

I don't have upgrade before. the test cluser is the new cluster with
hadoop-2.0.3. so I don't need to 'bin/hadoop dfsadmin –finalizeUpgrade'
On Thu, Nov 21, 2013 at 7:22 PM, Joshi, Rekha <[EMAIL PROTECTED]>wrote:

>  Hi Azurry,
>
> This error occurs when FSImage finds previous fs state, and as log states you would need to either finalizeUpgrade or rollback to proceed.Below -
>
> bin/hadoop dfsadmin –finalizeUpgrade
> hadoop dfsadmin –rollback
>
> On side note for a small test cluster on which one might suspect you are the only user, why wouldn't you insist on hot upgrade? :-)
>
> Thanks
> Rekha
>
> Some helpful guidelines for upgrade here -
>
> http://wiki.apache.org/hadoop/Hadoop_Upgrade
>
> https://twiki.grid.iu.edu/bin/view/Storage/HadoopUpgrade
>
> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html#Upgrading_from_older_release_to_0.23_and_configuring_federation
>
>
>   From: Azuryy Yu <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Thursday 21 November 2013 9:48 AM
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>, "
> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>
> Subject: HDFS upgrade problem of fsImage
>
>   Hi Dear,
>
>  I have a small test cluster with hadoop-2.0x, and HA configuraded, but I
> want to upgrade to hadoop-2.2.
>
>  I dont't want to stop cluster during upgrade, so my steps are:
>
>  1)  on standby NN: hadoop-dameon.sh stop namenode
> 2)  remove HA configuration in the conf
> 3)   hadoop-daemon.sh start namenode -upgrade -clusterID test-cluster
>
>  but Exception in the NN log, so how to upgrade and don't stop the whole
> cluster.
> Thanks.
>
>
>  org.apache.hadoop.hdfs.server.common.InconsistentFSStateException:
> Directory /hdfs/name is in an inconsistent state: previous fs state should
> not exist during upgrade. Finalize or rollback first.
>         at
> org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:323)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:248)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:858)
>         at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:620)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:445)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:494)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:692)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:677)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1345)
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB