Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Problem trying to set up single node cluster on Ubuntu


Copy link to this message
-
Re: Problem trying to set up single node cluster on Ubuntu
Look here
http://search-hadoop.com/m/NRMV72pWYVM1/ERROR+org.apache.hadoop.hdfs.server.datanode.DataNode%5C%3A+java.lang.IllegalArgumentException%5C%3A+Does+not+contain+a+valid+host%5C%3Aport+authority%5C%3A+/v=threaded

To solve this, you can check your config files: core-site.xml,
mapred-site.xml and hdfs-site.xml

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/#conf-site-xml

Of course, yo can check is the official documentation for 1.0.1:

http://hadoop.apache.org/common/docs/r1.0.1/single_node_setup.html

Regards

On 4/28/2012 3:19 PM, maddy gulati wrote:
> Folks,
>
> I am trying to set up a single node cluster for Hadoop ( version 1.0.1) on
> Ubuntu 11.04. After configuring everything, I could not get all the
> components to start.
>
> My installation directory for hadoop is /usr/local/hadoop
> I followed the following tutorial for the setup :
> http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
> Below is the snapshot of my log file:
>
> mandeep@mandeep-System-Product-Name:/var/log/hadoop/mandeep$ cat
> hadoop-mandeep-datanode-mandeep-System-Product-Name.log
> 2012-04-29 01:29:37,240 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG:   host = mandeep-System-Product-Name/127.0.1.1
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = 1.0.1
> STARTUP_MSG:   build > https://svn.apache.org/repos/asf/hadoop/common/branches/branch-1.0 -r
> 1243785; compiled by 'hortonfo' on Tue Feb 14 08:15:38 UTC 2012
> ************************************************************/
> 2012-04-29 01:29:37,398 INFO org.apache.hadoop.metrics2.impl.MetricsConfig:
> loaded properties from hadoop-metrics2.properties
> 2012-04-29 01:29:37,446 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> MetricsSystem,sub=Stats registered.
> 2012-04-29 01:29:37,449 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot
> period at 10 second(s).
> 2012-04-29 01:29:37,449 INFO
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: DataNode metrics system
> started
> 2012-04-29 01:29:37,583 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi
> registered.
> 2012-04-29 01:29:37,586 WARN
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Source name ugi already
> exists!
> 2012-04-29 01:29:37,615 INFO org.apache.hadoop.util.NativeCodeLoader:
> Loaded the native-hadoop library
> 2012-04-29 01:29:37,701 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode:
> java.lang.IllegalArgumentException: Does not contain a valid host:port
> authority: file:///
>   at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:198)
>   at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getAddress(NameNode.java:228)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.getServiceAddress(NameNode.java:222)
>   at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:337)
> at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:299)
>   at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1582)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1521)
>   at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1539)
> at
> org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1665)
>   at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1682)
>
> 2012-04-29 01:29:37,718 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at mandeep-System-Product-Name/
> 127.0.1.1
> ************************************************************/

Marcos Luis Ort�z Valmaseda (@marcosluis2186)
  Data Engineer at UCI
  http://marcosluis2186.posterous.com

10mo. ANIVERSARIO DE LA CREACION DE LA UNIVERSIDAD DE LAS CIENCIAS INFORMATICAS...
CONECTADOS AL FUTURO, CONECTADOS A LA REVOLUCION

http://www.uci.cu
http://www.facebook.com/universidad.uci
http://www.flickr.com/photos/universidad_uci