Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Submitting MapReduce job from remote server using JobClient

Copy link to this message
Submitting MapReduce job from remote server using JobClient
Amit Sela 2013-01-24, 12:13
Hi all,

I want to run a MapReduce job using the Hadoop Java api from my analytics
server. It is not the master or even a data node but it has the same Hadoop
installation as all the nodes in the cluster.
I tried using JobClient.runJob() but it accepts JobConf as argument and
when using JobConf it is possible to set only mapred Mapper classes and I
use mapreduce...
I tried using JobControl and ControlledJob but it seems like it tries to
run the job locally. the map phase just keeps attempting...
Anyone tried it before ?
I'm just looking for a way to submit MapReduce jobs from Java code and be
able to monitor them.


Harsh J 2013-01-24, 15:12
Amit Sela 2013-01-24, 16:15
Amit Sela 2013-01-27, 11:43
Panshul Whisper 2013-01-27, 11:53