Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Sequence file compression in Hive


Copy link to this message
-
Re: Sequence file compression in Hive
Sachin, it works

SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/000000_0 | less
SEQ^F"org.apache.hadoop.io.BytesWritable^Yorg.apache.hadoop.io.Text^A^A'org.apache.hadoop.io.compress.GzipCodec^
On Mon, Jun 10, 2013 at 11:15 AM, Stephen Sprague <[EMAIL PROTECTED]>wrote:

>
> On Mon, Jun 10, 2013 at 12:48 AM, Sachin Sudarshana <
> [EMAIL PROTECTED]> wrote:
>
> what's the header of the first sequence file look like?
>
> *$ dfs -cat
> /user/hive/warehouse/facts_520.db/test3facts520_gzip_seq/000000_0 | head
> *
>
>
>