Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - Re: Flume secure communication


Copy link to this message
-
Re: Flume secure communication
Deepak Tiwari 2013-03-12, 12:29
Thanks Inder and Mike.

My only thought was that since security has been a prime concern when we
transfer any data, so what could be the reason that its was not given as
much priority as it could have been. Could it be because since the transfer
in RPC and using avro serialized data, so its not same as transferring in
plain text and It might be difficult if not impossible for someone to troll?

Regards,

Deepak

On Tue, Mar 12, 2013 at 12:29 AM, Inder Pall <[EMAIL PROTECTED]> wrote:

> As a cheap solution you can always setup a ssh tunnel through port
> forwarding to do this outside of flume...though it would need to be managed
> for timeouts/network errors
>
> Inder
>
>
> On Tuesday, March 12, 2013, Mike Percy wrote:
>
>> No network encryption support yet but there is a patch up at
>> https://issues.apache.org/jira/browse/FLUME-997 for this functionality.
>> You are welcome to take a look and provide any comments. Not sure what you
>> mean by #2, you would have to share more about your requirements / use case.
>>
>> Regards,
>> Mike
>>
>> On Mar 11, 2013, at 11:26 PM, Deepak Tiwari <[EMAIL PROTECTED]> wrote:
>>
>> Hi,
>>>
>>> I have to install Flume and ensure that data transfer from Agent to
>>> Collector to Sink is secure enough. I noticed that some changes related ssl
>>> in FLUME-13 and that is very old. I see some discussion at
>>> http://search-hadoop.com/m/Unjdh2ovsNE/v=plain but I dont know if there
>>> is any update after.
>>>
>>> I request someone, if possible to give a qualified answer to
>>>
>>> 1. Is encryption possible in the Agent to Collector to Sink
>>> communication.
>>> 2. If not, does that mean RPC communication is secure enough if not
>>> encrypted.
>>> 3. Any pointers for security related design.
>>>
>>> Thanks very much for reading this much and appreciate someone's insight.
>>>
>>> Regards,
>>>
>>> Deepak
>>>
>>>
>
> --
> - Inder
> "You are average of the 5 people you spend the most time with"
>
>