Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ENOENT error


Copy link to this message
-
RE: ENOENT error
Yes, for some reason, although I specify local mode, hadoop is coming into picture.
bash-4.1$ which java/usr/bin/java
bash-4.1$ ls -lrt /usr/bin/javalrwxrwxrwx 1 root root 22 Oct 31 16:17 /usr/bin/java -> /etc/alternatives/java
bash-4.1$ ls -lrt /etc/alternatives/javalrwxrwxrwx 1 root root 46 Oct 31 16:17 /etc/alternatives/java -> /usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java
I tried rest the following the variables:bash-4.1$ export HADOOP_HOME=bash-4.1$ export HADOOP_CONF_DIR=bash-4.1$ pig -x local local-hcc-cidmrn-richer.pig/users/p529444/software/hadoop-1.0.3/bin/hadoop: line 320: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.9.x86_64: is a directory/users/p529444/software/hadoop-1.0.3/bin/hadoop: line 390: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.9.x86_64: is a directory/users/p529444/software/hadoop-1.0.3/bin/hadoop: line 390: exec: /usr/lib/jvm/java-1.7.0-openjdk-1.7.0.9.x86_64: cannot execute: Success

If I don't reset HADOOP_HOME and HADOOP_CONF_DIR variables, I get the following errors:
at org.apache.hadoop.io.nativeio.NativeIO.chmod(Native Method) at org.apache.hadoop.fs.FileUtil.execSetPermission(FileUtil.java:699) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:654) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509) at org.apache.hadoop.fs.RawLocalFileSystem.mkdirs(RawLocalFileSystem.java:344) at org.apache.hadoop.fs.FilterFileSystem.mkdirs(FilterFileSystem.java:189) at org.apache.hadoop.mapreduce.JobSubmissionFiles.getStagingDir(JobSubmissionFiles.java:116) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:856) at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:850) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1121) at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:850) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:824) at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378) at org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobControl.java:247) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:601) at org.apache.pig.backend.hadoop20.PigJobControl.mainLoopAction(PigJobControl.java:157) at org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:134) at java.lang.Thread.run(Thread.java:722) at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:257)
If I set my  JAVA_HOME in the following way I get this:export JAVA_HOME="/usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java"bash-4.1$ pig -x local local-hcc-cidmrn-richer.pigException in thread "main" java.io.IOException: Permission denied at java.io.UnixFileSystem.createFileExclusively(Native Method) at java.io.File.createTempFile(File.java:1879) at org.apache.hadoop.util.RunJar.main(RunJar.java:115)

> Date: Tue, 14 Jan 2014 16:09:03 -0500
> Subject: Re: ENOENT error
> From: [EMAIL PROTECTED]
> To: [EMAIL PROTECTED]
>
> Ive never seen this in localmode.  Are you sure ?  I see the job client
> submitting the job.  but i thought local mode never invoked mapreduce.    i
> could be wrong but , in any case, do share more details if possible.
>
>
> On Tue, Jan 14, 2014 at 3:19 PM, Sameer Tilak <[EMAIL PROTECTED]> wrote:
>
> > Hi All,
> > I am trying to run a pig script in local mode. The input.seq file is
> > present in the current directory. I checked the permissions at the staging
> > area and here is the o/p.
> > ls -lrt /apps/hadoop/hadoop-data/mapred/local/total 4drwxr-xr-x 2 userid
> > groupid 4096 Jan 8 13:48 jobTracker
> > I am encountering the following error message and any help would be highly
> > appreciated.
     
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB