Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> Merging some improvements to branch-2


Copy link to this message
-
Re: Merging some improvements to branch-2
+1

I've reviewed several of these patches and think they should be fine to go
into branch-2.

--
Aaron T. Myers
Software Engineer, Cloudera

On Thu, Jun 7, 2012 at 2:51 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:

> Hi all,
>
> I plan to merge the following JIRAs to branch-2 this week unless there
> are any objections:
>
> "Direct read" optimization:
>
> 6e51b33 HADOOP-8135. Add ByteBufferReadable interface to
> FSDataInputStream. Contributed by Henry Robinson.
> 4418682 HADOOP-8244. Improve comments on ByteBufferReadable.read.
> Contributed by Henry Robinson.
> c66f982 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream.
> Contributed by Henry Robinson.
> 467acd1 HDFS-3110. Use directRead API to reduce the number of buffer
> copies in libhdfs. Contributed by Henry Robinson.
>
> These improvements give a substantial savings in CPU to applications
> using libhdfs, and have some potential for usage in apps like HBase
> and MR as well.
>
> MiniDFSClusterManager:
> bfa5c0a HDFS-3167. CLI-based driver for MiniDFSCluster. Contributed by
> Henry Robinson.
> 21dfa6a HDFS-3235. MiniDFSClusterManager doesn't correctly support
> -format option. Contributed by Henry Robinson.
>
> These test-only improvements make it easier to construct system tests
> against realistic pseudo-distributed clusters.
>
> All of the above patches have been baking in trunk for quite some time.
>
> Thanks
> -Todd
> --
> Todd Lipcon
> Software Engineer, Cloudera
>