Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # dev - Review Request: Fix for SQOOP-1029


Copy link to this message
-
Re: Review Request: Fix for SQOOP-1053
Venkat Ranganathan 2013-05-21, 04:09

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/11288/
-----------------------------------------------------------

(Updated May 21, 2013, 4:09 a.m.)
Review request for Sqoop and Jarek Cecho.
Changes
-------

Fixed the summary title to properly reflect the bug being targeted
Summary (updated)
-----------------

Fix for SQOOP-1053
Description
-------

I updated the build and ivy settings to build Sqoop with Hadoop 2.0.4 alpha.
One of the compression tests (testBzip2TextCompression) fails with the following stack trace
Testcase: testBzip2TextCompression took 1.21 sec
Caused an ERROR
null
java.lang.NullPointerException
at org.apache.hadoop.io.compress.bzip2.Bzip2Factory.isNativeBzip2Loaded(Bzip2Factory.java:54)
at org.apache.hadoop.io.compress.bzip2.Bzip2Factory.getBzip2Decompressor(Bzip2Factory.java:123)
at org.apache.hadoop.io.compress.BZip2Codec.createDecompressor(BZip2Codec.java:250)
at org.apache.hadoop.io.compress.BZip2Codec.createInputStream(BZip2Codec.java:156)
at com.cloudera.sqoop.TestCompression.runTextCompressionTest(TestCompression.java:170)
at com.cloudera.sqoop.TestCompression.testBzip2TextCompression(TestCompression.java:189)
The reason is in 2.0.4, with native BZip2 codec, the configuration is checked and we don't do setConf for BZip2 codec. Fixed the test to set the configuration irrespective of whether it was passed in or we created the codec.
Diffs
-----

  build.xml 1c33fee
  ivy.xml 1fa4dd1
  src/test/com/cloudera/sqoop/TestCompression.java 048b87d

Diff: https://reviews.apache.org/r/11288/diff/
Testing
-------

Ran tests with the new settings and all tests pass
Thanks,

Venkat Ranganathan