Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # dev >> Review Request: FLUME-2027: Check for default replication fails on federated cluster in hdfs sink


+
Mike Percy 2013-04-29, 07:52
+
Mike Percy 2013-05-01, 07:34
+
Mike Percy 2013-05-01, 07:36
+
Hari Shreedharan 2013-05-06, 21:26
Copy link to this message
-
Re: Review Request: FLUME-2027: Check for default replication fails on federated cluster in hdfs sink

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10834/#review19938
-----------------------------------------------------------

pom.xml
<https://reviews.apache.org/r/10834/#comment41122>

    We should probably not bump the version up to 1.1.0, rather use reflection to call the method.
- Hari Shreedharan
On April 29, 2013, 7:52 a.m., Mike Percy wrote:
>
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/10834/
> -----------------------------------------------------------
>
> (Updated April 29, 2013, 7:52 a.m.)
>
>
> Review request for Flume.
>
>
> Description
> -------
>
> Federated HDFS has a new API which has been ported to Hadoop 1.1.0 and Hadoop 2.0.0-alpha from HADOOP-8014 which takes a Path argument to the FileSystem.getDefaultReplication() call. This patch simply moves the existing implementation over to that new API.
>
>
> This addresses bug FLUME-2027.
>     https://issues.apache.org/jira/browse/FLUME-2027
>
>
> Diffs
> -----
>
>   flume-ng-sinks/flume-hdfs-sink/pom.xml 2b6b5d2
>   flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AbstractHDFSWriter.java ff4f223
>   flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSCompressedDataStream.java 0c618b5
>   flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSDataStream.java c87fafe
>   flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSSequenceFile.java 1a401d6
>   pom.xml 686ecb6
>
> Diff: https://reviews.apache.org/r/10834/diff/
>
>
> Testing
> -------
>
> Unit tests pass.
>
>
> Thanks,
>
> Mike Percy
>
>