Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # dev - Review Request: Input format to read vector data from RC file


Copy link to this message
-
Review Request: Input format to read vector data from RC file
Sarvesh Sakalanaga 2013-05-10, 21:13

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11059/
-----------------------------------------------------------

Review request for hive.
Description
-------

Implementation of VectorizedColumnarSerDe and CommonRCInputFormat that can used to read vectorized data from RC file.
This addresses bug HIVE-4483.
    https://issues.apache.org/jira/browse/HIVE-4483
Diffs
-----

  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedBatchUtil.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedColumnarSerDe.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedRowBatchCtx.java 46256c4
  ql/src/java/org/apache/hadoop/hive/ql/exec/vector/VectorizedSerde.java 78a9084
  ql/src/java/org/apache/hadoop/hive/ql/io/CommonRCFileInputFormat.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/io/VectorizedRCFileInputFormat.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/io/VectorizedRCFileRecordReader.java PRE-CREATION
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/OrcSerde.java 1306710
  ql/src/java/org/apache/hadoop/hive/ql/io/orc/VectorizedOrcInputFormat.java bfcc765
  ql/src/test/org/apache/hadoop/hive/ql/exec/vector/TestVectorizedRowBatchCtx.java 1bc6c74
  serde/src/java/org/apache/hadoop/hive/serde2/columnar/ColumnarSerDe.java 11f5f07
  serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java 27ed4ef

Diff: https://reviews.apache.org/r/11059/diff/
Testing
-------

Unit test included.
Thanks,

Sarvesh Sakalanaga