Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: Error while running Hadoop Source Code


Copy link to this message
-
Re: Error while running Hadoop Source Code
 

Hi Vinod,

Thanks for your help regarding this. I checked the task
logs, this is what it is giving as output.

2013-11-06 06:40:05,541
INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM
ID: jvm_201311060636_0001_m_1100862588

2013-11-06 06:40:05,553 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_1100862588 spawned.

2013-11-06 06:40:05,650
INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM
ID: jvm_201311060636_0001_m_-1960039766

2013-11-06 06:40:05,651 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_-1960039766 spawned.

2013-11-06 06:40:07,496
INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_1100862588 given task: attempt_201311060
636_0001_m_000001_3

2013-11-06 06:40:07,618 INFO
org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_-1960039766 given task: attempt_20131106
0636_0001_m_000000_3

2013-11-06 06:40:08,013 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status:
false

2013-11-06 06:40:08,014 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:08,015 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:08,015 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:09,361 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201311060636_0001_m_000001_3 0.0%

2013-11-06 06:40:09,735 INFO
org.apache.hadoop.mapred.TaskTracker:
attempt_201311060636_0001_m_000000_3 0.0%

2013-11-06 06:40:10,018 INFO
org.apache.hadoop.mapred.JvmManager: JVM :
jvm_201311060636_0001_m_1100862588 exited. Number of tasks it ran: 0
2013-11-06 06:40:11,021 INFO org.apache.hadoop.mapred.JvmManager: JVM
: jvm_201311060636_0001_m_-1960039766 exited. Number of tasks it ran: 0
2013-11-06 06:40:11,442 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:11,442 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:11,443 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:11,443 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:13,021 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_201311060636_0001_m_000001_3 done; removing files.

2013-11-06
06:40:13,037 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot :
current free slots : 3

2013-11-06 06:40:14,025 INFO
org.apache.hadoop.mapred.TaskRunner:
attempt_201311060636_0001_m_000000_3 done; removing files.

2013-11-06
06:40:14,028 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot :
current free slots : 4

2013-11-06 06:40:14,476 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status:
false

2013-11-06 06:40:14,477 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:14,477 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:14,477 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:14,894 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu : false

2013-11-06 06:40:14,900 INFO
org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask):
attempt_201311060636_0001_m_000002_0 task's

state:UNASSIGNED
2013-11-06 06:40:14,902 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_201311060636_0001_m_000002_0 on CPU
2013-11-06 06:40:14,904 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free CPU slots : 4 and trying to launch
attempt_2013

11060636_0001_m_000002_0

2013-11-06 06:40:14,909 INFO
org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task:
attempt_201311060636_0001_m_000000_3

2013-11-06 06:40:14,920 INFO
org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task:
attempt_201311060636_0001_m_000001_3

2013-11-06 06:40:15,161 INFO
org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID:
jvm_201311060636_0001_m_164532908

2013-11-06 06:40:15,162 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_164532908 spawned.

2013-11-06 06:40:17,216
INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_164532908 given task: attempt_2013110606
36_0001_m_000002_0

Regards,

Indrashish

On Tue, 5 Nov 2013
10:09:36 -0800, Vinod Kumar Vavilapalli wrote:

pipes mapper is exiting before consuming all the input. Did you check
the task-logs on the web UI?
2013, at 7:25 AM, Basu,Indrashish wrote:
kindly assist on this ?
Nov 2013 10:23:23 -0500, Basu,Indrashish wrote:
Any update on the below post ?
needs more documentation. It src/test/org/apache/*hadoop
margin-left:5px; width:100%">*WordCountInputF
specific input split probably be recoded *to* use libhdfs *too*,
C++ example is using local file reads, it will only work on a cl
ft:5px; width:100%">if you have nfs or something working across the
lockquote> I would need some more light on the above exp
solid; margin-left:5px; width:100%">could elaborate a bit
needs to be done exactly. using Hadoop. .
margin-left:5px; width:100%">Regards, On Thu, 31 Oct 2013
Basu,Indrashish wrote: quote>
am tryi
processor and getting the below er
? px solid; m
No job jar file set. User h:100%">
margin-left:5px; width:100%">classes may not be found. See
JobConf(Class) or
3:12 INFO mapred.FileInputFormat: Total input paths to ockquote>
solid; margin-left:5px; width:100%">13/10/31 13:43:13 INFO
mapred.JobClient: Running job: job_201310311320
margin-left:5px; width:100%"> 13/10/31 13:43:14 INFO mapred.JobClient:
 
solid; margin-left:5px; width:100%">
Status : FAILED
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapR

2px solid; margin-left:5px; width:100%">
width:100%"> at org.apache.hadoop.mapred.MapTask.run(MapTa