Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: HDFS upgrade problem of fsImage


Copy link to this message
-
Re: HDFS upgrade problem of fsImage
Thanks Joshi,

Maybe I pasted wrong log messages.

please looked at here for the real story.

https://issues.apache.org/jira/browse/HDFS-5550
On Fri, Nov 22, 2013 at 6:25 PM, Joshi, Rekha <[EMAIL PROTECTED]>wrote:

>  Yes realized that and I see your point :-) However seems like some fs
> inconsistency present, did you attempt rollback/finalizeUpgrade and check?
>
>  For that error, FSImage.java/code finds a previous fs state -
>
> // Upgrade is allowed only if there are
>
>     // no previous fs states in any of the directories
>
>     for (Iterator<StorageDirectory> it = storage.dirIterator();
> it.hasNext();) {
>
>       StorageDirectory sd = it.next();
>
>       if (sd.getPreviousDir().exists())
>
>         throw new InconsistentFSStateException(sd.getRoot(),
>
>             "previous fs state should not exist during upgrade. "
>
>             + "Finalize or rollback first.");
>
>     }
>
>
>  Thanks
>
> Rekha
>
>
>   From: Azuryy Yu <[EMAIL PROTECTED]>
> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Date: Thursday 21 November 2013 5:19 PM
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Cc: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> Subject: Re: HDFS upgrade problem of fsImage
>
>   I insist hot upgrade on the test cluster because I want hot upgrade on
> the prod cluster.
>  On 2013-11-21 7:23 PM, "Joshi, Rekha" <[EMAIL PROTECTED]> wrote:
>
>>  Hi Azurry,
>>
>> This error occurs when FSImage finds previous fs state, and as log states you would need to either finalizeUpgrade or rollback to proceed.Below -
>>
>> bin/hadoop dfsadmin –finalizeUpgrade
>> hadoop dfsadmin –rollback
>>
>> On side note for a small test cluster on which one might suspect you are the only user, why wouldn't you insist on hot upgrade? :-)
>>
>> Thanks
>> Rekha
>>
>> Some helpful guidelines for upgrade here -
>>
>> http://wiki.apache.org/hadoop/Hadoop_Upgrade
>>
>> https://twiki.grid.iu.edu/bin/view/Storage/HadoopUpgrade
>>
>> http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-hdfs/Federation.html#Upgrading_from_older_release_to_0.23_and_configuring_federation
>>
>>
>>   From: Azuryy Yu <[EMAIL PROTECTED]>
>> Reply-To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> Date: Thursday 21 November 2013 9:48 AM
>> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>, "
>> [EMAIL PROTECTED]" <[EMAIL PROTECTED]>
>> Subject: HDFS upgrade problem of fsImage
>>
>>   Hi Dear,
>>
>>  I have a small test cluster with hadoop-2.0x, and HA configuraded, but
>> I want to upgrade to hadoop-2.2.
>>
>>  I dont't want to stop cluster during upgrade, so my steps are:
>>
>>  1)  on standby NN: hadoop-dameon.sh stop namenode
>> 2)  remove HA configuration in the conf
>> 3)   hadoop-daemon.sh start namenode -upgrade -clusterID test-cluster
>>
>>  but Exception in the NN log, so how to upgrade and don't stop the whole
>> cluster.
>> Thanks.
>>
>>
>>  org.apache.hadoop.hdfs.server.common.InconsistentFSStateException:
>> Directory /hdfs/name is in an inconsistent state: previous fs state should
>> not exist during upgrade. Finalize or rollback first.
>>         at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.doUpgrade(FSImage.java:323)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:248)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:858)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:620)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:445)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:494)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:692)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:677)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1279)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB