Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Sqoop >> mail # dev >> Review Request: Review request for SQOOP-1033 "CombineFileInputFormat does not work with paths not on default FS like ASV"


+
Shuaishuai Nie 2013-05-08, 00:38
Copy link to this message
-
Re: Review Request: Review request for SQOOP-1033 "CombineFileInputFormat does not work with paths not on default FS like ASV"

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10988/#review20319
-----------------------------------------------------------
Thanks for the patch.  You have the testing done section empty.  Can you please update what tests were done.  Is it possible to add a test (Integration Test at least)
src/java/org/apache/sqoop/mapreduce/CombineFileInputFormat.java
<https://reviews.apache.org/r/10988/#comment41840>

    Can you please add a comment explaining that this is done to preserve scheme and authority.   Is there a test that tests the export to ASV as part of SqlServer integration tests?
- Venkat Ranganathan
On May 8, 2013, 12:38 a.m., Shuaishuai Nie wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10988/
> -----------------------------------------------------------
>
> (Updated May 8, 2013, 12:38 a.m.)
>
>
> Review request for Sqoop.
>
>
> Description
> -------
>
> CombineFileInputFormat does not work with ASV. This appeared as an issue in Sqoop which failed to export files in ASV. CombineFileInputFormat strips out the scheme and authority components of the path, after which point the path is assumed to be on the default file system.
>  Sqoop has it own copy of CombineFileInputFormat, but updated the ones in core as well for consistency.
>
> There are currently already solved Jiras for the same issue:
> https://issues.apache.org/jira/browse/MAPREDUCE-2704
> https://issues.apache.org/jira/browse/MAPREDUCE-1806
>
>
> This addresses bug SQOOP-1033.
>     https://issues.apache.org/jira/browse/SQOOP-1033
>
>
> Diffs
> -----
>
>   src/java/org/apache/sqoop/mapreduce/CombineFileInputFormat.java 7d2be38
>
> Diff: https://reviews.apache.org/r/10988/diff/
>
>
> Testing
> -------
>
>
> Thanks,
>
> Shuaishuai Nie
>
>

+
Shuaishuai Nie 2013-05-08, 17:10
+
Shuaishuai Nie 2013-05-08, 17:11
+
Shuaishuai Nie 2013-05-08, 20:12
+
Shuaishuai Nie 2013-05-09, 22:16
+
Venkat Ranganathan 2013-05-10, 04:49
+
Shuaishuai Nie 2013-05-10, 14:51
+
Jarek Cecho 2013-05-20, 14:27
+
Venkat Ranganathan 2013-05-09, 21:57
+
Shuaishuai Nie 2013-05-08, 00:30
+
Venkat Ranganathan 2013-05-12, 15:48
+
Shuaishuai Nie 2013-05-13, 20:54
+
Shuaishuai Nie 2013-05-14, 00:31
+
Shuaishuai Nie 2013-05-16, 18:48
+
Venkat Ranganathan 2013-05-21, 20:03
+
Shuaishuai Nie 2013-05-23, 17:55
+
Venkat Ranganathan 2013-05-25, 00:37
+
Abhijeet Gaikwad 2013-06-03, 10:36
+
Jarek Cecho 2013-06-09, 16:02
+
Shuaishuai Nie 2013-06-12, 17:30
+
Jarek Cecho 2013-06-09, 16:23
+
Shuaishuai Nie 2013-06-12, 17:30
+
Shuaishuai Nie 2013-06-12, 17:30
+
Venkat Ranganathan 2013-06-12, 17:51
+
Jarek Cecho 2013-06-15, 17:41
+
Shuaishuai Nie 2013-06-18, 20:57
+
Shuaishuai Nie 2013-06-18, 20:57
+
Jarek Cecho 2013-06-18, 22:09
+
Shuaishuai Nie 2013-06-18, 22:24
+
Shuaishuai Nie 2013-05-21, 21:51
+
Shuaishuai Nie 2013-05-21, 21:10
+
Shuaishuai Nie 2013-05-22, 16:59
+
Shuaishuai Nie 2013-05-30, 17:11
+
Venkat Ranganathan 2013-05-30, 17:49
+
Venkat Ranganathan 2013-05-30, 06:55
+
Venkat Ranganathan 2013-05-22, 06:48
+
Raghav Gautam 2013-05-31, 20:37
+
Jarek Cecho 2013-06-02, 14:07
+
Raghav Gautam 2013-06-06, 03:56
+
Raghav Gautam 2013-06-06, 03:56
+
Jarek Cecho 2013-06-09, 15:17
+
Raghav Gautam 2013-06-10, 21:29
+
Venkat Ranganathan 2013-06-10, 23:32
+
Jarek Cecho 2013-06-11, 18:54