Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Re: NameNode low on available disk space


Copy link to this message
-
Re: NameNode low on available disk space
Mohit Vadhera 2013-02-28, 09:48
Thanks Harsh,  /mnt/san1/hdfs/cache/hdfs/dfs/name is not being created . If
I do compare with the older path the permissions are same on the parent
directories.
Do I need to create this this directory manually and set the permission ?

Older Path

# ll /var/lib/hadoop-hdfs/cache/hdfs/
total 4
drwxr-xr-x. 5 hdfs hdfs 4096 Dec 27 11:34 dfs

# ll /var/lib/hadoop-hdfs/cache/hdfs/dfs/
total 12
drwx------. 3 hdfs hdfs 4096 Dec 19 02:37 data
drwxr-xr-x. 3 hdfs hdfs 4096 Feb 28 02:36 name
drwxr-xr-x. 3 hdfs hdfs 4096 Feb 28 02:36 namesecondary
New Path

# ll /mnt/san1/hdfs/cache/hdfs/
total 4
drwxr-xr-x 3 hdfs hdfs 4096 Feb 28 02:08 dfs
# ll /mnt/san1/hdfs/cache/hdfs/dfs/
total 4
drwxr-xr-x 2 hdfs hdfs 4096 Feb 28 02:36 namesecondary
Thanks,

On Thu, Feb 28, 2013 at 1:59 PM, Harsh J <[EMAIL PROTECTED]> wrote:

> Hi,
>
> The exact error is displayed on your log and should be somewhat self
> explanatory:
>
> org.apache.hadoop.hdfs.server.common.InconsistentFSStateException:
> Directory /mnt/san1/hdfs/cache/hdfs/dfs/name is in an inconsistent
> state: storage directory does not exist or is not accessible.
>
> Please check this one's availability, permissions (the NN user should
> be able to access it).
>
> On Thu, Feb 28, 2013 at 1:46 PM, Mohit Vadhera
> <[EMAIL PROTECTED]> wrote:
> > Please find below logs for shutting down the namenode service. Can
> anybody
> > check this
> >
> > 2013-02-28 02:07:51,752 WARN org.apache.hadoop.hdfs.server.common.Util:
> Path
> > /mnt/san1/hdfs/cache/hdfs/dfs/name should be specified as a URI in
> > configuration files. Please update hdfs configuration.
> > 2013-02-28 02:07:51,754 WARN org.apache.hadoop.hdfs.server.common.Util:
> Path
> > /mnt/san1/hdfs/cache/hdfs/dfs/name should be specified as a URI in
> > configuration files. Please update hdfs configuration.
> > 2013-02-28 02:07:51,754 WARN
> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one image
> storage
> > directory (dfs.namenode.name.dir) configured. Beware of dataloss due to
> lack
> > of redundant storage directories!
> > 2013-02-28 02:07:51,754 WARN
> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Only one namespace
> > edits storage directory (dfs.namenode.edits.dir) configured. Beware of
> > dataloss due to lack of redundant storage directories!
> > 2013-02-28 02:07:51,884 INFO org.apache.hadoop.util.HostsFileReader:
> > Refreshing hosts (include/exclude) list
> > 2013-02-28 02:07:51,890 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager:
> > dfs.block.invalidate.limit=1000
> > 2013-02-28 02:07:51,909 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > dfs.block.access.token.enable=false
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > defaultReplication         = 1
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> maxReplication
> > = 512
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> minReplication
> > = 1
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > maxReplicationStreams      = 2
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > shouldCheckForEnoughRacks  = false
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > replicationRecheckInterval = 3000
> > 2013-02-28 02:07:51,910 INFO
> > org.apache.hadoop.hdfs.server.blockmanagement.BlockManager:
> > encryptDataTransfer        = false
> > 2013-02-28 02:07:51,920 INFO
> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner
> > > hdfs (auth:SIMPLE)
> > 2013-02-28 02:07:51,920 INFO
> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup
>  > > hadmin
> > 2013-02-28 02:07:51,920 INFO
> > org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled
> > > true
> > 2013-02-28 02:07:51,920 INFO