Hi all,

I would like to know how data security is handled in Chukwa. I think Chukwa does some encryption of data but how this encryption is done?
Does Chukwa use any certificates for this and if yes, how these certificates are updated/managed ?

Also would like to know that is the communication between agent and collector secure ?
I noted that Chukwa uses Http for data transfer, Are any other protocol also supported ?

Please also suggest any document/link which I can refer for data security management in Chukwa.

Thanks
Stuti

DISCLAIMER
=========This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.

Right now, nothing is encrypted. HTTP is the only protocol used to
send data to collectors.

On Mon, Aug 9, 2010 at 8:50 PM, Stuti Awasthi
<[EMAIL PROTECTED]> wrote:
> Hi all,
>
>
>
> I would like to know how data security is handled in Chukwa. I think Chukwa
> does some encryption of data but how this encryption is done?
>
> Does Chukwa use any certificates for this and if yes, how these certificates
> are updated/managed ?
>
>
>
> Also would like to know that is the communication between agent and
> collector secure ?
>
> I noted that Chukwa uses Http for data transfer, Are any other protocol also
> supported ?
>
>
>
> Please also suggest any document/link which I can refer for data security
> management in Chukwa.
>
>
>
> Thanks
>
> Stuti
>
>
>
>
>
> DISCLAIMER ========== This e-mail may contain privileged and confidential
> information which is the property of Persistent Systems Ltd. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Persistent Systems Ltd. does not accept any liability for
> virus infected mails.

--
Ari Rabkin [EMAIL PROTECTED]
UC Berkeley Computer Science Department

Hi,
Does that mean that there is no data security handled in Chukwa right now ?

-----Original Message-----
From: Ariel Rabkin [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, August 10, 2010 9:24 AM
To: [EMAIL PROTECTED]
Subject: Re: Data Security in Chukwa

Right now, nothing is encrypted. HTTP is the only protocol used to
send data to collectors.

On Mon, Aug 9, 2010 at 8:50 PM, Stuti Awasthi
<[EMAIL PROTECTED]> wrote:
> Hi all,
>
>
>
> I would like to know how data security is handled in Chukwa. I think Chukwa
> does some encryption of data but how this encryption is done?
>
> Does Chukwa use any certificates for this and if yes, how these certificates
> are updated/managed ?
>
>
>
> Also would like to know that is the communication between agent and
> collector secure ?
>
> I noted that Chukwa uses Http for data transfer, Are any other protocol also
> supported ?
>
>
>
> Please also suggest any document/link which I can refer for data security
> management in Chukwa.
>
>
>
> Thanks
>
> Stuti
>
>
>
>
>
> DISCLAIMER ========== This e-mail may contain privileged and confidential
> information which is the property of Persistent Systems Ltd. It is intended
> only for the use of the individual or entity to which it is addressed. If
> you are not the intended recipient, you are not authorized to read, retain,
> copy, print, distribute or use this message. If you have received this
> communication in error, please notify the sender and delete all copies of
> this message. Persistent Systems Ltd. does not accept any liability for
> virus infected mails.

--
Ari Rabkin [EMAIL PROTECTED]
UC Berkeley Computer Science Department

DISCLAIMER
=========This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.

Chukwa at present has a fairly minimal security model.

The rationale for this is that Hadoop (before v 21) also had a fairly
minimal security model, and there didn't seem much sense armoring the
collection system more than the underlying storage and processing
layer.

On Mon, Aug 9, 2010 at 8:57 PM, Stuti Awasthi
<[EMAIL PROTECTED]> wrote:
> Hi,
> Does that mean that there is no data security handled in Chukwa right now ?
>
> -----Original Message-----
> From: Ariel Rabkin [mailto:[EMAIL PROTECTED]]
> Sent: Tuesday, August 10, 2010 9:24 AM
> To: [EMAIL PROTECTED]
> Subject: Re: Data Security in Chukwa
>
> Right now, nothing is encrypted. HTTP is the only protocol used to
> send data to collectors.
>
> On Mon, Aug 9, 2010 at 8:50 PM, Stuti Awasthi
> <[EMAIL PROTECTED]> wrote:
>> Hi all,
>>
>>
>>
>> I would like to know how data security is handled in Chukwa. I think Chukwa
>> does some encryption of data but how this encryption is done?
>>
>> Does Chukwa use any certificates for this and if yes, how these certificates
>> are updated/managed ?
>>
>>
>>
>> Also would like to know that is the communication between agent and
>> collector secure ?
>>
>> I noted that Chukwa uses Http for data transfer, Are any other protocol also
>> supported ?
>>
>>
>>
>> Please also suggest any document/link which I can refer for data security
>> management in Chukwa.
>>
>>
>>
>> Thanks
>>
>> Stuti
>>
>>
>>
>>
>>
>> DISCLAIMER ========== This e-mail may contain privileged and confidential
>> information which is the property of Persistent Systems Ltd. It is intended
>> only for the use of the individual or entity to which it is addressed. If
>> you are not the intended recipient, you are not authorized to read, retain,
>> copy, print, distribute or use this message. If you have received this
>> communication in error, please notify the sender and delete all copies of
>> this message. Persistent Systems Ltd. does not accept any liability for
>> virus infected mails.
>
>
>
> --
> Ari Rabkin [EMAIL PROTECTED]
> UC Berkeley Computer Science Department
>
> DISCLAIMER
> =========> This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.
>

--
Ari Rabkin [EMAIL PROTECTED]
UC Berkeley Computer Science Department

Just curious what would the use case be for adding security to chukwa?  Our current use of it is all in an internal network/data--don't see much benefit of adding the complexity of configuring security.

On Aug 9, 2010, at 11:26 PM, Ariel Rabkin wrote:

> Chukwa at present has a fairly minimal security model.
>
> The rationale for this is that Hadoop (before v 21) also had a fairly
> minimal security model, and there didn't seem much sense armoring the
> collection system more than the underlying storage and processing
> layer.
>
> On Mon, Aug 9, 2010 at 8:57 PM, Stuti Awasthi
> <[EMAIL PROTECTED]> wrote:
>> Hi,
>> Does that mean that there is no data security handled in Chukwa right now ?
>>
>> -----Original Message-----
>> From: Ariel Rabkin [mailto:[EMAIL PROTECTED]]
>> Sent: Tuesday, August 10, 2010 9:24 AM
>> To: [EMAIL PROTECTED]
>> Subject: Re: Data Security in Chukwa
>>
>> Right now, nothing is encrypted. HTTP is the only protocol used to
>> send data to collectors.
>>
>> On Mon, Aug 9, 2010 at 8:50 PM, Stuti Awasthi
>> <[EMAIL PROTECTED]> wrote:
>>> Hi all,
>>>
>>>
>>>
>>> I would like to know how data security is handled in Chukwa. I think Chukwa
>>> does some encryption of data but how this encryption is done?
>>>
>>> Does Chukwa use any certificates for this and if yes, how these certificates
>>> are updated/managed ?
>>>
>>>
>>>
>>> Also would like to know that is the communication between agent and
>>> collector secure ?
>>>
>>> I noted that Chukwa uses Http for data transfer, Are any other protocol also
>>> supported ?
>>>
>>>
>>>
>>> Please also suggest any document/link which I can refer for data security
>>> management in Chukwa.
>>>
>>>
>>>
>>> Thanks
>>>
>>> Stuti
>>>
>>>
>>>
>>>
>>>
>>> DISCLAIMER ========== This e-mail may contain privileged and confidential
>>> information which is the property of Persistent Systems Ltd. It is intended
>>> only for the use of the individual or entity to which it is addressed. If
>>> you are not the intended recipient, you are not authorized to read, retain,
>>> copy, print, distribute or use this message. If you have received this
>>> communication in error, please notify the sender and delete all copies of
>>> this message. Persistent Systems Ltd. does not accept any liability for
>>> virus infected mails.
>>
>>
>>
>> --
>> Ari Rabkin [EMAIL PROTECTED]
>> UC Berkeley Computer Science Department
>>
>> DISCLAIMER
>> =========>> This e-mail may contain privileged and confidential information which is the property of Persistent Systems Ltd. It is intended only for the use of the individual or entity to which it is addressed. If you are not the intended recipient, you are not authorized to read, retain, copy, print, distribute or use this message. If you have received this communication in error, please notify the sender and delete all copies of this message. Persistent Systems Ltd. does not accept any liability for virus infected mails.
>>
>
>
>
> --
> Ari Rabkin [EMAIL PROTECTED]
> UC Berkeley Computer Science Department

There are people using Chukwa to stream data from/to EC2 to/from their own
colo.  It would be nice if the data is encrypted for privacy reasons.

Regards,
Eric

On 8/10/10 8:13 AM, "Corbin Hoenes" <[EMAIL PROTECTED]> wrote:

> Just curious what would the use case be for adding security to chukwa?  Our
> current use of it is all in an internal network/data--don't see much benefit
> of adding the complexity of configuring security.
>
> On Aug 9, 2010, at 11:26 PM, Ariel Rabkin wrote:
>
>> Chukwa at present has a fairly minimal security model.
>>
>> The rationale for this is that Hadoop (before v 21) also had a fairly
>> minimal security model, and there didn't seem much sense armoring the
>> collection system more than the underlying storage and processing
>> layer.
>>
>> On Mon, Aug 9, 2010 at 8:57 PM, Stuti Awasthi
>> <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>> Does that mean that there is no data security handled in Chukwa right now ?
>>>
>>> -----Original Message-----
>>> From: Ariel Rabkin [mailto:[EMAIL PROTECTED]]
>>> Sent: Tuesday, August 10, 2010 9:24 AM
>>> To: [EMAIL PROTECTED]
>>> Subject: Re: Data Security in Chukwa
>>>
>>> Right now, nothing is encrypted. HTTP is the only protocol used to
>>> send data to collectors.
>>>
>>> On Mon, Aug 9, 2010 at 8:50 PM, Stuti Awasthi
>>> <[EMAIL PROTECTED]> wrote:
>>>> Hi all,
>>>>
>>>>
>>>>
>>>> I would like to know how data security is handled in Chukwa. I think Chukwa
>>>> does some encryption of data but how this encryption is done?
>>>>
>>>> Does Chukwa use any certificates for this and if yes, how these
>>>> certificates
>>>> are updated/managed ?
>>>>
>>>>
>>>>
>>>> Also would like to know that is the communication between agent and
>>>> collector secure ?
>>>>
>>>> I noted that Chukwa uses Http for data transfer, Are any other protocol
>>>> also
>>>> supported ?
>>>>
>>>>
>>>>
>>>> Please also suggest any document/link which I can refer for data security
>>>> management in Chukwa.
>>>>
>>>>
>>>>
>>>> Thanks
>>>>
>>>> Stuti
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> DISCLAIMER ========== This e-mail may contain privileged and confidential
>>>> information which is the property of Persistent Systems Ltd. It is intended
>>>> only for the use of the individual or entity to which it is addressed. If
>>>> you are not the intended recipient, you are not authorized to read, retain,
>>>> copy, print, distribute or use this message. If you have received this
>>>> communication in error, please notify the sender and delete all copies of
>>>> this message. Persistent Systems Ltd. does not accept any liability for
>>>> virus infected mails.
>>>
>>>
>>>
>>> --
>>> Ari Rabkin [EMAIL PROTECTED]
>>> UC Berkeley Computer Science Department
>>>
>>> DISCLAIMER
>>> =========>>> This e-mail may contain privileged and confidential information which is the
>>> property of Persistent Systems Ltd. It is intended only for the use of the
>>> individual or entity to which it is addressed. If you are not the intended
>>> recipient, you are not authorized to read, retain, copy, print, distribute
>>> or use this message. If you have received this communication in error,
>>> please notify the sender and delete all copies of this message. Persistent
>>> Systems Ltd. does not accept any liability for virus infected mails.
>>>
>>
>>
>>
>> --
>> Ari Rabkin [EMAIL PROTECTED]
>> UC Berkeley Computer Science Department
>
>