Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # dev - [Discuss] Merge federation branch HDFS-1052 into trunk


Copy link to this message
-
Re: [Discuss] Merge federation branch HDFS-1052 into trunk
Konstantin Boudnik 2011-04-27, 05:40
Oops, the message came out garbled. I meant to say

I assume the outlined changes won't prevent an earlier version of HDFS from
upgrades to the federation version, right?

Thanks in advance,
  Cos

On Tue, Apr 26, 2011 at 17:59, Konstantin Boudnik <[EMAIL PROTECTED]> wrote:
> Sanjay,
>
> I assume the outlined changes won't an earlier version of HDFS from
> upgrads to the federation version, right?
>
> Cos
>
> On Tue, Apr 26, 2011 at 17:26, Sanjay Radia <[EMAIL PROTECTED]> wrote:
>>
>> Changes to the code base
>>  - The fundamental code change is to extend the notion of block id to now
>> include a block pool id.
>> - The  NN had little change, the protocols did change to include the block
>> pool id.
>> - The DN code did change. Each data structure is now indexed by the block
>> pool id -- while this is a code change, it is architecturally very simple
>> and low risk.
>> - We also did a fair amount of cleanup of threads used to send block reports
>> - while it was not strictly necessary to do the cleanup we took the extra
>> effort to pay the technical debt. As Dhruba recently noted, adding support
>> to send block reports to primary and secondary NN for HA will be now much
>> easier to do.
>