Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> HADOOP UPGRADE ISSUE


Copy link to this message
-
Re: HADOOP UPGRADE ISSUE
Make sure /opt/hadoop_newdata_dirr is 755 and not 777, and that it is owned
by the user that runs the DataNode (seems to be 'yogesh'). Once your DNs
are up, MR will fix itself.
On Thu, Nov 22, 2012 at 4:05 PM, yogesh dhari <[EMAIL PROTECTED]> wrote:

>  Hey Harsh,
>
> I have took down the instance on NN,
>
> and I started start-all.sh, but it doesn't run all demons.
>
> 1) Log file of DN...
>
> 2012-11-22 15:48:41,817 WARN
> org.apache.hadoop.hdfs.server.datanode.DataNode: Invalid directory in
> dfs.data.dir: Incorrect permission for /opt/hadoop_newdata_dirr, expected:
> rwxr-xr-x, while actual: rwxrwxrwx
> 2012-11-22 15:48:41,817 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: All directories in
> dfs.data.dir are invalid.
> 2012-11-22 15:48:41,817 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode
> 2012-11-22 15:48:41,830 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
>
> 2) Log file of TT...
>
> ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker
> because java.io.IOException: Call to localhost/127.0.0.1:9001 failed on
> local exception: java.io.IOException: Connection reset by peer
>     at org.apache.hadoop.ipc.Client.wrapException(Client.java:1107)
>     at org.apache.hadoop.ipc.Client.call(Client.java:1075)
>     at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225)
>     at org.apache.hadoop.mapred.$Proxy5.getProtocolVersion(Unknown Source)
>
> 3) Log file of NN...
> .
> .
> .
> .
> 2012-11-22 15:55:52,101 ERROR
> org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException
> as:yogesh cause:java.io.IOException: File
> /opt/hadoop-0.20.2/hadoop_temporary_dirr/mapred/system/jobtracker.infocould only be replicated to 0 nodes, instead of 1
> 2012-11-22 15:55:52,102 INFO org.apache.hadoop.ipc.Server: IPC Server
> handler 5 on 9000, call
> addBlock(/opt/hadoop-0.20.2/hadoop_temporary_dirr/mapred/system/
> jobtracker.info, DFSClient_-971904437, null) from 127.0.0.1:54047: error:
> java.io.IOException: File
> /opt/hadoop-0.20.2/hadoop_temporary_dirr/mapred/system/jobtracker.infocould only be replicated to 0 nodes, instead of 1
> java.io.IOException: File
> /opt/hadoop-0.20.2/hadoop_temporary_dirr/mapred/system/jobtracker.infocould only be replicated to 0 nodes, instead of 1
>     at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1558)
>     at
> org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:696)
>     at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source)
>     at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>     at java.lang.reflect.Method.invoke(Method.java:601)
>     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:563)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
>     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
>     at java.security.AccessController.doPrivileged(Native Method)
>     at javax.security.auth.Subject.doAs(Subject.java:415)
>     at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121)
>     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)
> 2012-11-22 15:55:56,291 INFO
> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
>
>
>
> ------------------------------------------------------------------------------------------------------------------------------------------
>
> Terminal's Output
>
> yogesh@yogesh-Aspire-5738:/opt/hadoop-1.0.4$ start-all.sh
> starting namenode, logging to
> /opt/hadoop-1.0.4/libexec/../logs/hadoop-yogesh-namenode-yogesh-Aspire-5738.out
> yogesh@localhost's password:
> localhost: starting datanode, logging to
> /opt/hadoop-1.0.4/libexec/../logs/hadoop-yogesh-datanode-yogesh-Aspire-5738.out
> yogesh@localhost's password:
> localhost: starting secondarynamenode, logging to
> /opt/hadoop-1.0.4/libexec/../logs/hadoop-yogesh-secondarynamenode-yogesh-Aspire-5738.out
> starting jobtracker, logging to

Harsh J