Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Is it possible to use AF_UINX sockets in hadoop?

Copy link to this message
Re: Is it possible to use AF_UINX sockets in hadoop?
Hi Raghu,

You might want to check out the work that's been done over at

Aaron T. Myers
Software Engineer, Cloudera

On Thu, Nov 24, 2011 at 12:56 PM, Raghu Reddy <[EMAIL PROTECTED]> wrote:

> Currently I'm experimenting with version 0.20.
> I would like to modify it so that it uses Unix Domain Sockets instead of
> INET sockets because we will be using this on a single node with a large
> number of cores.
> I would like to use junixsockets 1.3 implementation of AFUNIXSocket in
> place of INET sockets.
> The first question is is this possible?
> For the clients, it appears that one can provide a socket factory that
> returns AFUNIXSocket.  The problem seems to be to get the servers to use a
> different implementation because the servers are using
> ServerSocketChannels, and according to:
> <http://docs.oracle.com/**javase/6/docs/api/java/nio/**
> channels/ServerSocketChannel.**html<http://docs.oracle.com/javase/6/docs/api/java/nio/channels/ServerSocketChannel.html>
> >
> it is not possible to specify SocketImpl.
> I have tried to use ServerSocket.setSocketFactory(**) to try and set a
> different implementation, but I have not yet figured out if this is working
> or not.
> Does anyone have any idea if this is supposed to work?  Is there a better
> way of accomplishing this?
> Thanks!
> --rr