Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> running job without jar


+
exception 2010-10-26, 07:01
Copy link to this message
-
Re: running job without jar
As far as I know, there is no way to run a Java class on a cluster.

To copy user specified files to different nodes, you can use Distributed
Cache.

On Tue, Oct 26, 2010 at 3:01 PM, exception <[EMAIL PROTECTED]> wrote:

>  Hi,
>
>
>
> When launching a job in hadoop, usually we use “hadoop jar xxx.jar input
> output”.
>
> Can I run a job simply by a java program (In fully distributed mode),
> without packing a jar.
>
> I know this will cause problems because the remote nodes don’t have the
> source code and .class to run the mapper/reducer. So my next question is how
> to tell hadoop to copy user specified files to different nodes?
>
>
>
> Thanks.
>
+
David Rosenstrauch 2010-10-26, 14:13
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB