It seems like some of your nodes don't have correct permissions on the hadoop-log-dir, you should check that. It may be only a subset of nodes as you mentioned that Teragen seems to work.
You can start with the nodes where the tasks were reported as failed.
On Aug 30, 2012, at 10:08 AM, Jain, Prem wrote:
> I am trying to terasort and seems to fail with the following error ? Teragen seems to work well though
> 12/08/30 09:53:38 WARN mapred.JobClient: Error reading taskoutputhttp://datanode004.svl.ibm.com:50060/tasklog?plaintext=true&attemptid=attempt_201208300948_0001_m_000060_1&filter=stdout
> 12/08/30 09:53:38 WARN mapred.JobClient: Error reading task outputhttp:// datanode004.svl.ibm.com:50060/tasklog?plaintext=true&attemptid=attempt_201208300948_0001_m_000060_1&filter=stderr
> 12/08/30 09:53:39 INFO mapred.JobClient: Task Id : attempt_201208300948_0001_m_000152_1, Status : FAILED
> ENOENT: No such file or directory
> at org.apache.hadoop.io.nativeio.NativeIO.open(Native Method)
> at org.apache.hadoop.io.SecureIOUtils.createForWrite(SecureIOUtils.java:161)
> at org.apache.hadoop.mapred.TaskLog.writeToIndexFile(TaskLog.java:296)
> at org.apache.hadoop.mapred.TaskLog.syncLogs(TaskLog.java:369)
> at org.apache.hadoop.mapred.Child.main(Child.java:229
> The command I am running is:
> $ hadoop jar $HADOOP_HOME/hadoop-examples-1.0.0.jar terasort /user/netapp/input-dir /user/netapp/output-dir
> Thanks in advance