-Re: Is DFSInputStream.read(long position,...) designed for multi threaded access?
Jason Rutherglen 2011-03-02, 16:17
Thanks for the reply. I looked at HDFS-941 which seems to remove the
redundant creation of BlockReaders. That and HDFS-347 will solve some
of the issues, however I think there's also the sendmsg() of the file
descriptor that also needs to be implemented?
On Tue, Mar 1, 2011 at 5:58 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:
> Hi Jason,
> Yes, this method is currently very inefficient.. HDFS-941 will
> hopefully improve this situation, but currently there's no
> particularly efficient way to do multithreaded random access.
> On Tue, Mar 1, 2011 at 4:24 PM, Jason Rutherglen
> <[EMAIL PROTECTED]> wrote:
>> It's unsynchronized however it's creating a new BlockReader on each
>> call, that seems like a problem?
> Todd Lipcon
> Software Engineer, Cloudera