Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Re: Error while running Hadoop Source Code


Copy link to this message
-
Re: Error while running Hadoop Source Code
 

Hi Vinod,

Thanks for your help regarding this. I checked the task
logs, this is what it is giving as output.

2013-11-06 06:40:05,541
INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM
ID: jvm_201311060636_0001_m_1100862588

2013-11-06 06:40:05,553 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_1100862588 spawned.

2013-11-06 06:40:05,650
INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM
ID: jvm_201311060636_0001_m_-1960039766

2013-11-06 06:40:05,651 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_-1960039766 spawned.

2013-11-06 06:40:07,496
INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_1100862588 given task: attempt_201311060
636_0001_m_000001_3

2013-11-06 06:40:07,618 INFO
org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_-1960039766 given task: attempt_20131106
0636_0001_m_000000_3

2013-11-06 06:40:08,013 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status:
false

2013-11-06 06:40:08,014 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:08,015 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:08,015 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:09,361 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_201311060636_0001_m_000001_3 0.0%

2013-11-06 06:40:09,735 INFO
org.apache.hadoop.mapred.TaskTracker:
attempt_201311060636_0001_m_000000_3 0.0%

2013-11-06 06:40:10,018 INFO
org.apache.hadoop.mapred.JvmManager: JVM :
jvm_201311060636_0001_m_1100862588 exited. Number of tasks it ran: 0
2013-11-06 06:40:11,021 INFO org.apache.hadoop.mapred.JvmManager: JVM
: jvm_201311060636_0001_m_-1960039766 exited. Number of tasks it ran: 0
2013-11-06 06:40:11,442 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:11,442 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:11,443 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:11,443 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:13,021 INFO org.apache.hadoop.mapred.TaskRunner:
attempt_201311060636_0001_m_000001_3 done; removing files.

2013-11-06
06:40:13,037 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot :
current free slots : 3

2013-11-06 06:40:14,025 INFO
org.apache.hadoop.mapred.TaskRunner:
attempt_201311060636_0001_m_000000_3 done; removing files.

2013-11-06
06:40:14,028 INFO org.apache.hadoop.mapred.TaskTracker: addCPUFreeSlot :
current free slots : 4

2013-11-06 06:40:14,476 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from status:
false

2013-11-06 06:40:14,477 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:14,477 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu xx from status: false

2013-11-06 06:40:14,477 INFO
org.apache.hadoop.mapred.TaskTracker: running on gpu xx from task: false
2013-11-06 06:40:14,894 INFO org.apache.hadoop.mapred.TaskTracker:
running on gpu : false

2013-11-06 06:40:14,900 INFO
org.apache.hadoop.mapred.TaskTracker: LaunchTaskAction (registerTask):
attempt_201311060636_0001_m_000002_0 task's

state:UNASSIGNED
2013-11-06 06:40:14,902 INFO org.apache.hadoop.mapred.TaskTracker:
Trying to launch : attempt_201311060636_0001_m_000002_0 on CPU
2013-11-06 06:40:14,904 INFO org.apache.hadoop.mapred.TaskTracker: In
TaskLauncher, current free CPU slots : 4 and trying to launch
attempt_2013

11060636_0001_m_000002_0

2013-11-06 06:40:14,909 INFO
org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task:
attempt_201311060636_0001_m_000000_3

2013-11-06 06:40:14,920 INFO
org.apache.hadoop.mapred.TaskTracker: Received KillTaskAction for task:
attempt_201311060636_0001_m_000001_3

2013-11-06 06:40:15,161 INFO
org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID:
jvm_201311060636_0001_m_164532908

2013-11-06 06:40:15,162 INFO
org.apache.hadoop.mapred.JvmManager: JVM Runner
jvm_201311060636_0001_m_164532908 spawned.

2013-11-06 06:40:17,216
INFO org.apache.hadoop.mapred.TaskTracker: JVM with ID:
jvm_201311060636_0001_m_164532908 given task: attempt_2013110606
36_0001_m_000002_0

Regards,

Indrashish

On Tue, 5 Nov 2013
10:09:36 -0800, Vinod Kumar Vavilapalli wrote:

pipes mapper is exiting before consuming all the input. Did you check
the task-logs on the web UI?
2013, at 7:25 AM, Basu,Indrashish wrote:
kindly assist on this ?
Nov 2013 10:23:23 -0500, Basu,Indrashish wrote:
Any update on the below post ?
needs more documentation. It src/test/org/apache/*hadoop
margin-left:5px; width:100%">*WordCountInputF
specific input split probably be recoded *to* use libhdfs *too*,
C++ example is using local file reads, it will only work on a cl
ft:5px; width:100%">if you have nfs or something working across the
lockquote> I would need some more light on the above exp
solid; margin-left:5px; width:100%">could elaborate a bit
needs to be done exactly. using Hadoop. .
margin-left:5px; width:100%">Regards, On Thu, 31 Oct 2013
Basu,Indrashish wrote: quote>
am tryi
processor and getting the below er
? px solid; m
No job jar file set. User h:100%">
margin-left:5px; width:100%">classes may not be found. See
JobConf(Class) or
3:12 INFO mapred.FileInputFormat: Total input paths to ockquote>
solid; margin-left:5px; width:100%">13/10/31 13:43:13 INFO
mapred.JobClient: Running job: job_201310311320
margin-left:5px; width:100%"> 13/10/31 13:43:14 INFO mapred.JobClient:
 
solid; margin-left:5px; width:100%">
Status : FAILED
org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapR

2px solid; margin-left:5px; width:100%">
width:100%"> at org.apache.hadoop.mapred.MapTask.run(MapTa
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB