Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Pulling data from secured hadoop cluster to another hadoop cluster


+
samir das mohapatra 2013-05-28, 11:47
+
Nitin Pawar 2013-05-28, 12:29
Copy link to this message
-
Re: Pulling data from secured hadoop cluster to another hadoop cluster
Also Samir, when you say 'secured', by any chance that cluster is secured
with Kerberos (rather than ssh)?

-Shahab
On Tue, May 28, 2013 at 8:29 AM, Nitin Pawar <[EMAIL PROTECTED]>wrote:

> hadoop daemons do not use ssh to communicate.
>
> if  your distcp job could not connect to remote server then either the
> connection was rejected by the target namenode or the it was not able to
> establish the network connection.
>
> were you able to see the hdfs on server1 from server2?
>
>
> On Tue, May 28, 2013 at 5:17 PM, samir das mohapatra <
> [EMAIL PROTECTED]> wrote:
>
>> Hi All,
>>   I could able to connect the hadoop (source ) cluster after ssh is
>> established.
>>
>> But i wanted to know, If I want to pull some data using distcp from
>> source secured hadoop box to another hadoop cluster , I could not able to
>> ping  name node machine.  In this approach how to run distcp command from
>> target cluster in with secured connection.
>>
>> Source: hadoop.server1 (ssh secured)
>> Target:  hadoop.server2 (runing distcp here)
>>
>>
>> running command:
>>
>> distcp hftp://hadoop.server1:50070/dataSet
>> hdfs://hadoop.server2:54310/targetDataSet
>>
>>
>> Regards,
>> samir.
>>
>
>
>
> --
> Nitin Pawar
>