Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - Re: Flume secure communication


Copy link to this message
-
Re: Flume secure communication
Mike Percy 2013-03-12, 19:41
It's certainly possible to sniff the wire traffic using some tool like WireShark.

Regards,
Mike

Sent from my iPhone

On Mar 12, 2013, at 5:29 AM, Deepak Tiwari <[EMAIL PROTECTED]> wrote:

> Thanks Inder and Mike.
>
> My only thought was that since security has been a prime concern when we transfer any data, so what could be the reason that its was not given as much priority as it could have been. Could it be because since the transfer in RPC and using avro serialized data, so its not same as transferring in plain text and It might be difficult if not impossible for someone to troll?
>
> Regards,
>
> Deepak
>
> On Tue, Mar 12, 2013 at 12:29 AM, Inder Pall <[EMAIL PROTECTED]> wrote:
>> As a cheap solution you can always setup a ssh tunnel through port forwarding to do this outside of flume...though it would need to be managed for timeouts/network errors
>>
>> Inder
>>
>>
>> On Tuesday, March 12, 2013, Mike Percy wrote:
>>> No network encryption support yet but there is a patch up at https://issues.apache.org/jira/browse/FLUME-997 for this functionality. You are welcome to take a look and provide any comments. Not sure what you mean by #2, you would have to share more about your requirements / use case.
>>>
>>> Regards,
>>> Mike
>>>
>>> On Mar 11, 2013, at 11:26 PM, Deepak Tiwari <[EMAIL PROTECTED]> wrote:
>>>
>>>>> Hi,
>>>>>
>>>>> I have to install Flume and ensure that data transfer from Agent to Collector to Sink is secure enough. I noticed that some changes related ssl in FLUME-13 and that is very old. I see some discussion at http://search-hadoop.com/m/Unjdh2ovsNE/v=plain but I dont know if there is any update after.
>>>>>
>>>>> I request someone, if possible to give a qualified answer to
>>>>>
>>>>> 1. Is encryption possible in the Agent to Collector to Sink communication.
>>>>> 2. If not, does that mean RPC communication is secure enough if not encrypted.
>>>>> 3. Any pointers for security related design.
>>>>>
>>>>> Thanks very much for reading this much and appreciate someone's insight.
>>>>>
>>>>> Regards,
>>>>>
>>>>> Deepak
>>
>>
>> --
>> - Inder
>> "You are average of the 5 people you spend the most time with"
>