Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - EC2, Hadoop, copy file from CLUSTER_MASTER to CLUSTER, failing


Copy link to this message
-
Re: EC2, Hadoop, copy file from CLUSTER_MASTER to CLUSTER, failing
Saptarshi Guha 2009-06-24, 18:07
Hello,
Thank you. This is quite useful.

Regards
Saptarshi
On Wed, Jun 24, 2009 at 6:16 AM, Tom White<[EMAIL PROTECTED]> wrote:
> Hi Saptarshi,
>
> The group permissions open the firewall ports to enable access, but
> there are no shared keys on the cluster by default. See
> https://issues.apache.org/jira/browse/HADOOP-4131 for a patch to the
> scripts that shares keys to allow SSH access between machines in the
> cluster.
>
> Cheers,
> Tom
>
> On Sat, Jun 20, 2009 at 7:09 AM, Saptarshi Guha<[EMAIL PROTECTED]> wrote:
>> Hello,
>> I have a cluster with 1 master and 1 slave (testing). In the EC2
>> scripts, in the hadoop-ec2-init-remote.sh file, I wish to copy a file
>> from
>> the MASTER to the CLUSTER i.e in the slave section
>>
>>  scp $MASTER_HOST:/tmp/v  /tmp/v
>>
>> However, this didnt work and when I logged in, ssh'd to the slave and
>> tried the command, I got the following error:
>>
>> Permission denied (publickey,gssapi-with-mic)
>>
>> Yet, the group permissions appear to be valid i.e
>>  ec2-authorize $CLUSTER_MASTER -o $CLUSTER -u $AWS_ACCOUNT_ID
>>  ec2-authorize $CLUSTER -o $CLUSTER_MASTER -u $AWS_ACCOUNT_ID
>>
>> So I don't see why I can't ssh into the MASTER group from a slave.
>>
>> Any suggestion as to where I'm going wrong?
>> Regards
>> Saptarshi
>>
>> P.S I know I can copy a file from S3, but would like to know what is
>> going on here.
>>
>