Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive, mail # dev - Review Request 15663: Hive should be able to skip header and footer rows when reading data file for a table


Copy link to this message
-
Re: Review Request 15663: Hive should be able to skip header and footer rows when reading data file for a table
Eric Hanson 2013-11-19, 01:31

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/15663/
-----------------------------------------------------------

(Updated Nov. 19, 2013, 1:31 a.m.)
Review request for hive and Thejas Nair.
Bugs: HIVE-5795
    https://issues.apache.org/jira/browse/HIVE-5795
Repository: hive-git
Description
-------

Hive should be able to skip header and footer rows when reading data file for a table

(I am uploading this on behalf of Shuaishuai Nie since he's not in the office)
Diffs
-----

  common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 32ab3d8
  data/files/header_footer_table_1/0001.txt PRE-CREATION
  data/files/header_footer_table_1/0002.txt PRE-CREATION
  data/files/header_footer_table_1/0003.txt PRE-CREATION
  data/files/header_footer_table_2/2012/01/01/0001.txt PRE-CREATION
  data/files/header_footer_table_2/2012/01/02/0002.txt PRE-CREATION
  data/files/header_footer_table_2/2012/01/03/0003.txt PRE-CREATION
  itests/qtest/pom.xml a453d8a
  ql/src/java/org/apache/hadoop/hive/ql/exec/FetchOperator.java 5abcfc1
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java dd5cb6b
  ql/src/java/org/apache/hadoop/hive/ql/io/HiveInputFormat.java 0ec6e63
  ql/src/test/org/apache/hadoop/hive/ql/io/TestHiveBinarySearchRecordReader.java 85dd975
  ql/src/test/org/apache/hadoop/hive/ql/io/TestSymlinkTextInputFormat.java 0686d9b
  ql/src/test/queries/clientpositive/file_with_header_footer.q PRE-CREATION
  ql/src/test/results/clientpositive/file_with_header_footer.q.out PRE-CREATION

Diff: https://reviews.apache.org/r/15663/diff/
Testing
-------
Thanks,

Eric Hanson