Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Question regarding hadoop jar command usage


Copy link to this message
-
Re: Question regarding hadoop jar command usage
bejoy.hadoop@... 2013-03-13, 17:16
Hi

Any node would submit the job to JobTracker which distributes the jar to TaskTrackers and individual tasks are executed on nodes across the cluster.

MR tasks are executed across the cluster.

Regards
Bejoy KS

Sent from remote device, Please excuse typos

-----Original Message-----
From: KayVajj <[EMAIL PROTECTED]>
Date: Wed, 13 Mar 2013 09:01:42
To: <[EMAIL PROTECTED]>
Reply-To: [EMAIL PROTECTED]
Subject: Question regarding hadoop jar command usage

I have a question regarding the hadoop jar command. In a cluster of say
nodes n1,n2...n100

the node n1 has jar Myjar on its local file system.

If I run the command
hadoop jar local/path/to/Myjar Myclass other-args

Is the MR job executed just on n1 or any arbitrary node n1..n100?

If it is any arbitrary node, since Myjar exists only on n1. Is the jar
copied across all nodes on the cluster to run the MR code.