Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # dev >> review request for two patches related to serde-reported schemas


Copy link to this message
-
review request for two patches related to serde-reported schemas
Hey hive gurus -

Would it be possible for a committer to take a look at the following two issues?

"Hive should expand nested structs when setting the table schema from
thrift structs"
https://issues.apache.org/jira/browse/HIVE-2941

"Hive should store the full table schema in partition storage descriptors"
https://issues.apache.org/jira/browse/HIVE-2950
DETAILS:

The general issue is handling serde-reported schemas. If the
serde-reported structure contains nested structures they are not
expanded, causing downstream issues for HCatalog & not fully
describing the table for users browsing schemas. Also, the partition
schema does not have serde-reported fields copied to its storage
descriptor causing issues.

Serde-reported schemas are super useful, and these two patches should
make it even better. The issues themselves have far more details,
including examples of current & proposed behavior.

Thanks!
Travis
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB