Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ERROR 2118: Input path does not exist


Copy link to this message
-
Re: ERROR 2118: Input path does not exist
The put command that Marek described can do that.
http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#put

You will need to have hadoop client on that machine or move data to a
machine that has it. Copying 10GB of data over a LAN (?) should not take
too long.

-Thejas
On 9/20/11 12:22 AM, kiranprasad wrote:
> How can I LOAD a file which is in another machine, of 10 GB size.
>
> -----Original Message----- From: Marek Miglinski
> Sent: Tuesday, September 20, 2011 12:19 PM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> Hey,
>
> '/data/test.txt' is supposed to be on hdfs (if your not executing with
> -x local), put it there from your local drive with command:
> hadoop fs -put
>
> for ex, create dir and the put:
> hadoop fs -mkdir /data
> hadoop fs -put /data/test.txt /data/
>
>
> Sincerely,
> Marek M.
> ________________________________________
> From: kiranprasad [[EMAIL PROTECTED]]
> Sent: Tuesday, September 20, 2011 7:47 AM
> To: [EMAIL PROTECTED]
> Subject: Re: ERROR 2118: Input path does not exist
>
> Hi Marek
>
> I got the response as below
>
> [kiranprasad.g@pig4 bin]$ ./hadoop fs -ls /
> Found 1 items
> drwxr-xr-x - kiranprasad.g supergroup 0 2011-09-19 19:23 /tmp
> but after loading (A= LOAD '/data/test.txt' USING PigStorage();),
> I am getting the same exception.
>
> Message: org.apache.pig.backend.executionengine.
> ExecException: ERROR 2118: Input path does not exist:
> hdfs://10.0.0.61/data/msis
> dns.txt
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput
> Format.getSplits(PigInputFormat.java:280)
> at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
> 79)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
> at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobCont
> rol.java:247)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:27
> 9)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
> Input pa th does not
> exist: hdfs://10.0.0.61/data/msisdns.txt
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File
> InputFormat.java:224)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextI
> nputFormat.listStatus(PigTextInputFormat.java:36)
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileI
> nputFormat.java:241)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput
> Format.getSplits(PigInputFormat.java:268)
> ... 7 more
>
>
> where is the default path of the data.txt configured ?
>
> Regards
> Kiran.G
>
> -----Original Message-----
> From: Marek Miglinski
> Sent: Monday, September 19, 2011 3:14 PM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> hadoop fs -ls /
>
> BACKSHASH at the end!
>
> And:
> A= LOAD '/data/test.txt' USING PigStorage();
>
> BACKSLASH before data!
>
>
> -----Original Message-----
> From: kiranprasad [mailto:[EMAIL PROTECTED]]
> Sent: Monday, September 19, 2011 12:10 PM
> To: [EMAIL PROTECTED]
> Subject: Re: ERROR 2118: Input path does not exist
>
> Hi
>
> I am unable t run the below mentioned command : hadoop fs -ls getting the
> same output.
>
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
> ls: Cannot access .: No such file or directory.
>
> Below is the exception.
> Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> Input path does not exist:
> hdfs://10.0.0.61/home/kiranprasad.g/pig-0.8.1/data/msisdns.txt
>
> Regards
> Kiran.G
>
> -----Original Message-----
> From: Marek Miglinski
> Sent: Sunday, September 18, 2011 1:09 AM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> I meant that you should use absolute path when you load HDFS path from PIG,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB