Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # dev - [Discuss] Merge federation branch HDFS-1052 into trunk


Copy link to this message
-
Re: [Discuss] Merge federation branch HDFS-1052 into trunk
Konstantin Boudnik 2011-04-27, 00:59
Sanjay,

I assume the outlined changes won't an earlier version of HDFS from
upgrads to the federation version, right?

Cos

On Tue, Apr 26, 2011 at 17:26, Sanjay Radia <[EMAIL PROTECTED]> wrote:
>
> Changes to the code base
>  - The fundamental code change is to extend the notion of block id to now
> include a block pool id.
> - The  NN had little change, the protocols did change to include the block
> pool id.
> - The DN code did change. Each data structure is now indexed by the block
> pool id -- while this is a code change, it is architecturally very simple
> and low risk.
> - We also did a fair amount of cleanup of threads used to send block reports
> - while it was not strictly necessary to do the cleanup we took the extra
> effort to pay the technical debt. As Dhruba recently noted, adding support
> to send block reports to primary and secondary NN for HA will be now much
> easier to do.