Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # dev >> NameNode rollEdidLog: removing storage


+
James Kinley 2012-06-14, 16:16
+
Todd Lipcon 2012-06-14, 16:48
Copy link to this message
-
Re: NameNode rollEdidLog: removing storage
Hi Todd,

Yes, sorry I should have said we are running CDH3u2.

Thanks, James.

On 14 Jun 2012, at 17:48, Todd Lipcon <[EMAIL PROTECTED]> wrote:

> Hi James,
>
> Could you please let us know exactly what version of Hadoop you're
> running? This is an area that has had some bug fixes throughout the
> last year, so identifying the particular version is important.
>
> -Todd
>
> On Thu, Jun 14, 2012 at 9:16 AM, James Kinley
> <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> Our production cluster started reporting "too many open files" this
>> afternoon and subsequently was unable to save any snapshots to disk.
>> We have been able to recover it ok, but I would have expected the NN
>> to complain more if it cannot save a snapshot. All I saw in the log
>> was...
>>
>> "WARN org.apache.hadoop.hdfs.server.common.Storage: rollEdidLog:
>> removing storage <local dir>"
>> "WARN org.apache.hadoop.hdfs.server.common.Storage: rollEdidLog:
>> removing storage <nfs dir>"
>>
>> Do you think this should trigger the NN to enter safe mode. The longer
>> this goes un-noticed, the more data could be lost if the NN cannot be
>> recovered?
>>
>> Regards,
>>
>> James.
>
>
>
> --
> Todd Lipcon
> Software Engineer, Cloudera
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB