Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Question regarding hadoop jar command usage

KayVajj 2013-03-13, 16:01
Copy link to this message
Re: Question regarding hadoop jar command usage
bejoy.hadoop@... 2013-03-13, 17:16

Any node would submit the job to JobTracker which distributes the jar to TaskTrackers and individual tasks are executed on nodes across the cluster.

MR tasks are executed across the cluster.

Bejoy KS

Sent from remote device, Please excuse typos

-----Original Message-----
Date: Wed, 13 Mar 2013 09:01:42
Subject: Question regarding hadoop jar command usage

I have a question regarding the hadoop jar command. In a cluster of say
nodes n1,n2...n100

the node n1 has jar Myjar on its local file system.

If I run the command
hadoop jar local/path/to/Myjar Myclass other-args

Is the MR job executed just on n1 or any arbitrary node n1..n100?

If it is any arbitrary node, since Myjar exists only on n1. Is the jar
copied across all nodes on the cluster to run the MR code.

Sandy Ryza 2013-03-13, 17:14
KayVajj 2013-03-13, 18:07
Sandy Ryza 2013-03-13, 18:34