Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Review Request: FLUME-2027: Check for default replication fails on federated cluster in hdfs sink


Copy link to this message
-
Re: Review Request: FLUME-2027: Check for default replication fails on federated cluster in hdfs sink

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/10834/
-----------------------------------------------------------

(Updated May 1, 2013, 7:34 a.m.)
Review request for Flume.
Changes
-------

Hari thanks for the review! I agree, updated the patch.
Description
-------

Federated HDFS has a new API which has been ported to Hadoop 1.1.0 and Hadoop 2.0.0-alpha from HADOOP-8014 which takes a Path argument to the FileSystem.getDefaultReplication() call. This patch simply moves the existing implementation over to that new API.
This addresses bug FLUME-2027.
    https://issues.apache.org/jira/browse/FLUME-2027
Diffs (updated)
-----

  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/AbstractHDFSWriter.java ff4f223
  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSCompressedDataStream.java 0c618b5
  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSDataStream.java c87fafe
  flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSSequenceFile.java 1a401d6

Diff: https://reviews.apache.org/r/10834/diff/
Testing
-------

Unit tests pass.
Thanks,

Mike Percy