Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir


Copy link to this message
-
Re: On CDH2, (Cloudera EC2) No valid local directories in property: mapred.local.dir
Hello,
I fixed this by running more than >=2 slaves.
I was testing with 1 when this error occurred.

Regards
Saptarshi

On Tue, Feb 23, 2010 at 2:57 PM, Todd Lipcon <[EMAIL PROTECTED]> wrote:
> Hi Saptarshi,
>
> Can you please ssh into the JobTracker node and check that this
> directory is mounted, writable by the hadoop user, and not full?
>
> -Todd
>
> On Fri, Feb 19, 2010 at 2:13 PM, Saptarshi Guha
> <[EMAIL PROTECTED]> wrote:
>> Hello,
>> Not sure if i should post this here or on Cloudera's message board,
>> but here goes.
>> When I run EC2 using the latest CDH2 and Hadoop 0.20 (by settiing the
>> env variables are hadoop-ec2),
>> and launch a job
>> hadoop jar ...
>>
>> I get the following error
>>
>>
>> 10/02/19 17:04:55 WARN mapred.JobClient: Use GenericOptionsParser for
>> parsing the arguments. Applications should implement Tool for the
>> same.
>> org.apache.hadoop.ipc.RemoteException: java.io.IOException: No valid
>> local directories in property: mapred.local.dir
>>        at org.apache.hadoop.conf.Configuration.getLocalPath(Configuration.java:975)
>>        at org.apache.hadoop.mapred.JobConf.getLocalPath(JobConf.java:279)
>>        at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:256)
>>        at org.apache.hadoop.mapred.JobInProgress.<init>(JobInProgress.java:240)
>>        at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3026)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>>        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>>        at java.lang.reflect.Method.invoke(Method.java:597)
>>        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:508)
>>        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:966)
>>        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:962)
>>        at java.security.AccessController.doPrivileged(Native Method)
>>        at javax.security.auth.Subject.doAs(Subject.java:396)
>>        at org.apache.hadoop.ipc.Server$Handler.run(Server.java:960)
>>
>>        at org.apache.hadoop.ipc.Client.call(Client.java:740)
>>        at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:220)
>>        at org.apache.hadoop.mapred.$Proxy0.submitJob(Unknown Source)
>>        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:841)
>>        at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
>>
>>        at org.godhuli.f.RHMR.submitAndMonitorJob(RHMR.java:195)
>>
>> but the value  of mapred.local.dir is "/mnt/hadoop/mapred/local"
>>
>> Any ideas?
>>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB