Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Re: HDFS Federation Exception


Copy link to this message
-
Re: HDFS Federation Exception
Hi,

The documentation (1) suggested to set the `dfs.namenode.rpc-address.ns1`
property to `hdfs://nn-host1:rpc-port` in the example. Changing the value
to `nn-host1:rpc-port` (removing hdfs://) solved the problem. The document
needs to be updated.

(1) -
http://hadoop.apache.org/common/docs/r0.23.0/hadoop-yarn/hadoop-yarn-site/Federation.html

Praveen

On Wed, Jan 11, 2012 at 3:40 PM, Praveen Sripati
<[EMAIL PROTECTED]>wrote:

> Hi,
>
> Got the latest code to see if any bugs were fixed and did try federation
> with the same configuration, but was getting similar exception.
>
> 2012-01-11 15:25:35,321 ERROR namenode.NameNode (NameNode.java:main(803))
> - Exception in namenode join
> java.io.IOException: Failed on local exception: java.net.SocketException:
> Unresolved address; Host Details : local host is: "hdfs"; destination host
> is: "(unknown):0;
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:895)
>         at org.apache.hadoop.ipc.Server.bind(Server.java:231)
>         at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:313)
>         at org.apache.hadoop.ipc.Server.<init>(Server.java:1600)
>         at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:576)
>         at
> org.apache.hadoop.ipc.WritableRpcEngine$Server.<init>(WritableRpcEngine.java:322)
>         at
> org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:282)
>         at
> org.apache.hadoop.ipc.WritableRpcEngine.getServer(WritableRpcEngine.java:46)
>         at org.apache.hadoop.ipc.RPC.getServer(RPC.java:550)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.<init>(NameNodeRpcServer.java:145)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:356)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:334)
>
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:458)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:450)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:751)
>         at
> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:799)
> Caused by: java.net.SocketException: Unresolved address
>         at sun.nio.ch.Net.translateToSocketException(Net.java:58)
>         at sun.nio.ch.Net.translateException(Net.java:84)
>         at sun.nio.ch.Net.translateException(Net.java:90)
>         at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:61)
>         at org.apache.hadoop.ipc.Server.bind(Server.java:229)
>         ... 14 more
> Caused by: java.nio.channels.UnresolvedAddressException
>         at sun.nio.ch.Net.checkAddress(Net.java:30)
>         at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:122)
>         at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
>         ... 15 more
>
> Regards,
> Praveen
>
> On Wed, Jan 11, 2012 at 12:24 PM, Praveen Sripati <
> [EMAIL PROTECTED]> wrote:
>
>>
>> Hi,
>>
>> I am trying to setup a HDFS federation and getting the below error. Also,
>> pasted the core-site.xml and hdfs-site.xml at the bottom of the mail. Did I
>> miss something in the configuration files?
>>
>> 2012-01-11 12:12:15,759 ERROR namenode.NameNode
>> (NameNode.java:main(803)) - Exception in namenode join
>> java.lang.IllegalArgumentException: Can't parse port ''
>>         at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:198)
>>         at
>> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:153)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:174)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:205)
>>         at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.getRpcServerAddress(NameNode.java:266)
>>         at