-2.0.3-alpha in pseudodristributed mode: How to force examples to run on yarn?
Jens Scheidtmann 2013-03-19, 08:33
I finally have set up 2.0.3-alpha in pseudo distributed mode as per
This is evidenced by having yarn resourcemanager and nodemanager running,
no exceptions in the logs and I am able to access their web interfaces. The
node manager has registered in the resourcemanager.
Instead of setting all the listed environment variables, I opted for
setting HADOOP_HOME correctly, and used the supplied start-yarn.sh script.
When running randomwriter as indicated on the above website, I notice that
the local job runner is used, which means only one map task is ever used.
Am I missing a configuration setting to have examples run on yarn?
Is there a way to fail Jobs, when they are using LocalJobRunner?
Thanks in advance,
Jens Scheidtmann 2013-03-19, 19:23
Harsh J 2013-03-20, 00:06