Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> Sequence file compression in Hive


Copy link to this message
-
Re: Sequence file compression in Hive
Sachin, it works

SET hive.exec.compress.output=true;
SET mapred.output.compression.codec=org.apache.hadoop.io.compress.GzipCodec;
SET mapred.output.compression.type=BLOCK;
create table data1_seq STORED AS SEQUENCEFILE as select * from date1;
hadoop fs -cat /user/hive/warehouse/data1_seq/000000_0 | less
SEQ^F"org.apache.hadoop.io.BytesWritable^Yorg.apache.hadoop.io.Text^A^A'org.apache.hadoop.io.compress.GzipCodec^
On Mon, Jun 10, 2013 at 11:15 AM, Stephen Sprague <[EMAIL PROTECTED]>wrote:

>
> On Mon, Jun 10, 2013 at 12:48 AM, Sachin Sudarshana <
> [EMAIL PROTECTED]> wrote:
>
> what's the header of the first sequence file look like?
>
> *$ dfs -cat
> /user/hive/warehouse/facts_520.db/test3facts520_gzip_seq/000000_0 | head
> *
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB