Hadoop, mail # user - Re: What is the best way to load data from one cluster to another cluster (Urgent requirement)

Re: What is the best way to load data from one cluster to another cluster (Urgent requirement)

Satbeer Lamba 2013-01-31, 05:49

I might be wrong but have you considered distcp?
On Jan 31, 2013 11:15 AM, "samir das mohapatra" <[EMAIL PROTECTED]>
wrote:

> Hi All,
>
> Any one knows, how to load data from one hadoop cluster(CDH4) to
> another Cluster (CDH4) . They way our project needs are
> 1) It should be delta load or incremental load.
> 2) It should be based on the timestamp
> 3) Data volume are 5PB
>
> Any Help ????????????
>
> Regards,
> samir.
>

Re: What is the best way to load data from one cluster to another cluster (Urgent requirement)

samir das mohapatra 2013-01-31, 06:15

thanks all.
On Thu, Jan 31, 2013 at 11:19 AM, Satbeer Lamba <[EMAIL PROTECTED]>wrote:

> I might be wrong but have you considered distcp?
> On Jan 31, 2013 11:15 AM, "samir das mohapatra" <[EMAIL PROTECTED]>
> wrote:
>
>> Hi All,
>>
>> Any one knows, how to load data from one hadoop cluster(CDH4) to
>> another Cluster (CDH4) . They way our project needs are
>> 1) It should be delta load or incremental load.
>> 2) It should be based on the timestamp
>> 3) Data volume are 5PB
>>
>> Any Help ????????????
>>
>> Regards,
>> samir.
>>
>