Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Re: Encryption in HDFS


+
Seonyeong Bak 2013-02-26, 06:51
+
Ted Dunning 2013-02-26, 05:55
+
Ted Yu 2013-02-26, 05:24
+
lohit 2013-02-26, 05:15
+
Seonyeong Bak 2013-02-26, 05:33
Copy link to this message
-
Re: Encryption in HDFS
Excellent!

On 02/25/2013 10:43 PM, Mathias Herberts wrote:
> Encryption without proper key management only addresses the 'stolen
> hard drive' problem.
>
> So far I have not found 100% satisfactory solutions to this hard
> problem. I've written OSS (Open Secret Server) partly to address this
> problem in Pig, i.e. accessing encrypted data without embedding key
> info into the job description file. Proper encrypted data handling
> implies striict code review though, as in the case of Pig databags are
> spillable and you could end up with unencrypted data stored on disk
> without intent.
>
> OSS http://github.com/hbs/oss and the Pig specific code:
> https://github.com/hbs/oss/blob/master/src/main/java/com/geoxp/oss/pig/PigSecretStore.java
>
> On Tue, Feb 26, 2013 at 6:33 AM, Seonyeong Bak <[EMAIL PROTECTED]> wrote:
>> I didn't handle a key distribution problem because I thought that this
>> problem is more difficult.
>> I simply hardcode a key into the code.
>>
>> A challenge related to security are handled in HADOOP-9331, MAPREDUCE-5025,
>> and so on.