Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # general >> What's different of 1)namenode metadata 2)image and 3)edit logs?


+
Steve Gao 2009-11-16, 20:45
Copy link to this message
-
Re: What's different of 1)namenode metadata 2)image and 3)edit logs?
NameNode metadata - is in memory data structures describing file system
structure (directories, files, and file's blocks).

NameNode image is on-disk representation of the metadata. (fsimage file).

Edit logs - is a journal that keeps all the events that cause changes in the
metadata and allows restoration in case of NameNode failure.

Secondary Namenode - runs checkpoints from time to time. During a checkpoint
edit logs are merged into metadata and saved to fsimage, which is pushed to
the NameNode.

Boris.
On 11/16/09 12:45 PM, "Steve Gao" <[EMAIL PROTECTED]> wrote:

> What are the differences between the 3 concepts: (1) namenode metadata, (2)
> namenode image, and (3) edit logs?
>
> BTW,I know the secondary namenode backups namenode data.
>
> I was told that there is another daemon which also backups meta data . Is that
> true? What is the daemon? Thanks.
>
>
>
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB