Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Fixed Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir


Copy link to this message
-
Fixed Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir
As a follow up, this is not peculiar to my programs but hadoop ones too:
I started the cluster as (using Fedora AMI and c1.medium)

hadoop-ec2 launch-cluster --env REPO=testing --env HADOOP_VERSION=0.20 test2 1

and error is [1]

But it works(and so do my programs) if I launch a cluster with e.g. 4
nodes as opposed to 1.

Regards
Saptarshi

[1]

[root@ip-10-250-195-225 ~]# hadoop jar
/usr/lib/hadoop-0.20/hadoop-0.20.1+169.56-examples.jar  wordcount
/tmp/foo /tmp/f1
10/02/19 17:31:45 WARN conf.Configuration: DEPRECATED: hadoop-site.xml
found in the classpath. Usage of hadoop-site.xml is deprecated.
Instead use core-site.xml, mapred-site.xml and hdfs-site.xml to
override properties of core-default.xml, mapred-default.xml and
hdfs-default.xml respectively
10/02/19 17:31:45 INFO input.FileInputFormat: Total input paths to process : 1
org.apache.hadoop.ipc.RemoteException: java.io.IOException: No valid
local directories in property: mapred.local.dir
at org.apache.hadoop.conf.Configuration.getLocalPath(Configuration.java:975)
at org.apache.hadoop.mapred.JobConf.getLocalPath(JobConf.java:279)
at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:256)
at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:240)
at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3026)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:966)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:962)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:960)

at org.apache.hadoop.ipc.Client.call(Client.java:740)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
at org.apache.hadoop.mapred.$Proxy0.submitJob(Unknown Source)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:841)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:447)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

On Fri, Feb 19, 2010 at 5:13 PM, Saptarshi Guha
<[EMAIL PROTECTED]> wrote:
> Hello,
> Not sure if i should post this here or on Cloudera's message board,
> but here goes.
> When I run EC2 using the latest CDH2 and Hadoop 0.20 (by settiing the
> env variables are hadoop-ec2),
> and launch a job
> hadoop jar ...
>
> I get the following error
>
>
> 10/02/19 17:04:55 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the
> same.
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: No valid
> local directories in property: mapred.local.dir
>        at org.apache.hadoop.conf.Configuration.getLocalPath(Configuration.java:975)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB