Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # dev - Is it possible to use AF_UINX sockets in hadoop?


Copy link to this message
-
Re: Is it possible to use AF_UINX sockets in hadoop?
Aaron T. Myers 2011-11-28, 04:06
Hi Raghu,

You might want to check out the work that's been done over at
https://issues.apache.org/jira/browse/HDFS-347.

--
Aaron T. Myers
Software Engineer, Cloudera

On Thu, Nov 24, 2011 at 12:56 PM, Raghu Reddy <[EMAIL PROTECTED]> wrote:

> Currently I'm experimenting with version 0.20.
>
> I would like to modify it so that it uses Unix Domain Sockets instead of
> INET sockets because we will be using this on a single node with a large
> number of cores.
>
> I would like to use junixsockets 1.3 implementation of AFUNIXSocket in
> place of INET sockets.
>
> The first question is is this possible?
>
> For the clients, it appears that one can provide a socket factory that
> returns AFUNIXSocket.  The problem seems to be to get the servers to use a
> different implementation because the servers are using
> ServerSocketChannels, and according to:
>
> <http://docs.oracle.com/**javase/6/docs/api/java/nio/**
> channels/ServerSocketChannel.**html<http://docs.oracle.com/javase/6/docs/api/java/nio/channels/ServerSocketChannel.html>
> >
>
> it is not possible to specify SocketImpl.
>
> I have tried to use ServerSocket.setSocketFactory(**) to try and set a
> different implementation, but I have not yet figured out if this is working
> or not.
>
> Does anyone have any idea if this is supposed to work?  Is there a better
> way of accomplishing this?
>
> Thanks!
>
> --rr
>