Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - how to compress log files with snappy compression


Copy link to this message
-
Re: how to compress log files with snappy compression
Mathias Herberts 2011-12-31, 22:29
write a simple java class that creates a snappy compressed seqfile.
On Dec 31, 2011 11:17 PM, "ravikumar visweswara" <[EMAIL PROTECTED]>
wrote:

> Hello All,
>
> Is there a way to compress my text log files in snappy format on Mac OSX
> and Linux before or while pushing to hdfs?
>
> I dont want to run another map job to do the compression.
>
> -R
>