Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # user - What is the use of compressed field in the hive storage descriptor


Copy link to this message
-
Re: What is the use of compressed field in the hive storage descriptor
Edward Capriolo 2013-09-26, 23:24
Some table types like rc file can have internal compression. It has
different meaning based on the serde used.

On Thursday, September 26, 2013, KayVajj <[EMAIL PROTECTED]> wrote:
> A desc extended command results in the following
> Table(
> tableName:table_namet,
> dbName:cybs_test,
> owner:[EMAIL PROTECTED],
> createTime:1380232668,
> lastAccessTime:0,
> retention:0,
> sd:StorageDescriptor(
>   cols:[
>     FieldSchema(name:a, type:string, comment:null),
> FieldSchema(name:b, type:string, comment:null),
> FieldSchema(name:c, type:string, comment:null),
> FieldSchema(name:d, type:string, comment:null),
> FieldSchema(name:e, type:string, comment:null),
> FieldSchema(name:f, type:timestamp, comment:null),
> FieldSchema(name:date_added, type:timestamp, comment:null),
> FieldSchema(name:g, type:string, comment:null),
> FieldSchema(name:h, type:string, comment:null),
> FieldSchema(name:i, type:string, comment:null),
> FieldSchema(name:j, type:string, comment:null)
> ],
> location:xyz
> inputFormat:org.apache.hadoop.mapred.SequenceFileInputFormat,
> outputFormat:org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat,
> compressed:false,
> numBuckets:-1,
> serdeInfo:SerDeInfo(
>  name:null,
>  serializationLib:org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe,
>  parameters:{colelction.delim=, mapkey.delim=, serialization.format=,
field.delim=}
> ),
> bucketCols:[],
> sortCols:[],
> parameters:{},
> skewedInfo:SkewedInfo(skewedColNames:[], skewedColValues:[],
skewedColValueLocationMaps:{}),
> storedAsSubDirectories:false
> ),
> partitionKeys:[FieldSchema(name:dt, type:int, comment:null)],
> parameters:{numPartitions=1, numFiles=5, EXTERNAL=TRUE,
transient_lastDdlTime=1380233065, totalSize=340426, numRows=0,
comment=Request Table from ODS, rawDataSize=0},
> viewOriginalText:null,
> viewExpandedText:null,
> tableType:EXTERNAL_TABLE
> )
> What is the meaning of the highlighted field?
> Thanks
>
>
>