Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> authentication when uploading in to hadoop HDFS


Copy link to this message
-
Re: authentication when uploading in to hadoop HDFS
Thanks a ton Nitin just wanted to confirm for the point below

an external user wont be able to write in to our cluster using any API
right as we didnt included his ip in our cluster using password less ssh
for him i guess ssh will prompt a password for writes and reads correct me
if i am wrong :)
only admin has ssh access to linux clusters
====>if no one has ssh access then password less ssh does not do any harm.

On Fri, Aug 30, 2013 at 12:35 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:

> well have access to read from hdfs using webhdfs :
> ===>you may want to secure it with IP and username based authentications
>
> as of now we dunt  have any security specific to hdfs user level we have
> se permissions=true for a particular user
> ====>if you are managing user level access control then it should be
> technically safe that anyone other that hdfs superuser can not create and
> change permissions for user directories.
>
> only admin has ssh access to linux clusters
> ====>if no one has ssh access then password less ssh does not do any harm.
>
>
> On Fri, Aug 30, 2013 at 12:17 PM, Visioner Sadak <[EMAIL PROTECTED]
> > wrote:
>
>> well have access to read from hdfs using webhdfs
>>
>> as of now we dunt  have any security specific to hdfs
>>
>> user level we have se permissions=true for a particular user
>>
>> only admin has ssh access to linux clusters
>>
>>
>>
>>
>>
>>
>> On Fri, Aug 30, 2013 at 12:14 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
>>
>>> Visioner,
>>> is your cluster accessible on public network?
>>> What kind of hdfs security you have kept in place?
>>> what is your cluster security?(user level, intranet level)
>>> who all have ssh-keys to login to any node on the cluster?
>>>
>>>
>>>
>>>
>>> On Fri, Aug 30, 2013 at 12:08 PM, Visioner Sadak <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> also we have done a password-less ssh within our clusters only so that
>>>>  we can access the cluster but i guess this wont be the case for an
>>>> external user right
>>>>
>>>>
>>>> On Fri, Aug 30, 2013 at 12:05 PM, Visioner Sadak <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> Hello friends we use filesystem.copyFrmLocal method of java api within
>>>>> a tomcat conntainer  to move data in to   hadoop clusters, will any other
>>>>> unauthorised user will be able to write in to our hadoop cluster using the
>>>>> java api or is any extra authenticaton needed from our side
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Nitin Pawar
>>>
>>
>>
>
>
> --
> Nitin Pawar
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB