Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - running job without jar


Copy link to this message
-
Re: running job without jar
David Rosenstrauch 2010-10-26, 14:13
On 10/26/2010 03:01 AM, exception wrote:
> Hi,
>
> When launching a job in hadoop, usually we use "hadoop jar xxx.jar
> input output". Can I run a job simply by a java program (In fully
> distributed mode), without packing a jar. I know this will cause
> problems because the remote nodes don't have the source code and
> .class to run the mapper/reducer. So my next question is how to tell
> hadoop to copy user specified files to different nodes?
>
> Thanks.
>

Yes, this can be easily done.  See:
http://www.mail-archive.com/[EMAIL PROTECTED]/msg01114.html

HTH,

DR