|
|
-
2.0.3-alpha in pseudodristributed mode: How to force examples to run on yarn?Jens Scheidtmann 2013-03-19, 08:33
Dear all,
I finally have set up 2.0.3-alpha in pseudo distributed mode as per http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html This is evidenced by having yarn resourcemanager and nodemanager running, no exceptions in the logs and I am able to access their web interfaces. The node manager has registered in the resourcemanager. Instead of setting all the listed environment variables, I opted for setting HADOOP_HOME correctly, and used the supplied start-yarn.sh script. When running randomwriter as indicated on the above website, I notice that the local job runner is used, which means only one map task is ever used. Am I missing a configuration setting to have examples run on yarn? Is there a way to fail Jobs, when they are using LocalJobRunner? Thanks in advance, Jens |