Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> What is the use of compressed field in the hive storage descriptor


Copy link to this message
-
Re: What is the use of compressed field in the hive storage descriptor
Some table types like rc file can have internal compression. It has
different meaning based on the serde used.

On Thursday, September 26, 2013, KayVajj <[EMAIL PROTECTED]> wrote:
> A desc extended command results in the following
> Table(
> tableName:table_namet,
> dbName:cybs_test,
> owner:[EMAIL PROTECTED],
> createTime:1380232668,
> lastAccessTime:0,
> retention:0,
> sd:StorageDescriptor(
>   cols:[
>     FieldSchema(name:a, type:string, comment:null),
> FieldSchema(name:b, type:string, comment:null),
> FieldSchema(name:c, type:string, comment:null),
> FieldSchema(name:d, type:string, comment:null),
> FieldSchema(name:e, type:string, comment:null),
> FieldSchema(name:f, type:timestamp, comment:null),
> FieldSchema(name:date_added, type:timestamp, comment:null),
> FieldSchema(name:g, type:string, comment:null),
> FieldSchema(name:h, type:string, comment:null),
> FieldSchema(name:i, type:string, comment:null),
> FieldSchema(name:j, type:string, comment:null)
> ],
> location:xyz
> inputFormat:org.apache.hadoop.mapred.SequenceFileInputFormat,
> outputFormat:org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat,
> compressed:false,
> numBuckets:-1,
> serdeInfo:SerDeInfo(
>  name:null,
>  serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,
>  parameters:{colelction.delim=, mapkey.delim=, serialization.format=,
field.delim=}
> ),
> bucketCols:[],
> sortCols:[],
> parameters:{},
> skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[],
skewedColValueLocationMaps:{}),
> storedAsSubDirectories:false
> ),
> partitionKeys:[FieldSchema(name:dt, type:int, comment:null)],
> parameters:{numPartitions=1, numFiles=5, EXTERNAL=TRUE,
transient_lastDdlTime=1380233065, totalSize=340426, numRows=0,
comment=Request Table from ODS, rawDataSize=0},
> viewOriginalText:null,
> viewExpandedText:null,
> tableType:EXTERNAL_TABLE
> )
> What is the meaning of the highlighted field?
> Thanks
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB