Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> ERROR 2118: Input path does not exist


Copy link to this message
-
Re: ERROR 2118: Input path does not exist
The put command that Marek described can do that.
http://hadoop.apache.org/common/docs/r0.20.0/hdfs_shell.html#put

You will need to have hadoop client on that machine or move data to a
machine that has it. Copying 10GB of data over a LAN (?) should not take
too long.

-Thejas
On 9/20/11 12:22 AM, kiranprasad wrote:
> How can I LOAD a file which is in another machine, of 10 GB size.
>
> -----Original Message----- From: Marek Miglinski
> Sent: Tuesday, September 20, 2011 12:19 PM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> Hey,
>
> '/data/test.txt' is supposed to be on hdfs (if your not executing with
> -x local), put it there from your local drive with command:
> hadoop fs -put
>
> for ex, create dir and the put:
> hadoop fs -mkdir /data
> hadoop fs -put /data/test.txt /data/
>
>
> Sincerely,
> Marek M.
> ________________________________________
> From: kiranprasad [[EMAIL PROTECTED]]
> Sent: Tuesday, September 20, 2011 7:47 AM
> To: [EMAIL PROTECTED]
> Subject: Re: ERROR 2118: Input path does not exist
>
> Hi Marek
>
> I got the response as below
>
> [kiranprasad.g@pig4 bin]$ ./hadoop fs -ls /
> Found 1 items
> drwxr-xr-x - kiranprasad.g supergroup 0 2011-09-19 19:23 /tmp
> but after loading (A= LOAD '/data/test.txt' USING PigStorage();),
> I am getting the same exception.
>
> Message: org.apache.pig.backend.executionengine.
> ExecException: ERROR 2118: Input path does not exist:
> hdfs://10.0.0.61/data/msis
> dns.txt
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput
> Format.getSplits(PigInputFormat.java:280)
> at
> org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:885)
> at
> org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:7
> 79)
> at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:730)
> at org.apache.hadoop.mapred.jobcontrol.Job.submit(Job.java:378)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.startReadyJobs(JobCont
> rol.java:247)
> at
> org.apache.hadoop.mapred.jobcontrol.JobControl.run(JobControl.java:27
> 9)
> at java.lang.Thread.run(Thread.java:619)
> Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException:
> Input pa th does not
> exist: hdfs://10.0.0.61/data/msisdns.txt
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(File
> InputFormat.java:224)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextI
> nputFormat.listStatus(PigTextInputFormat.java:36)
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileI
> nputFormat.java:241)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInput
> Format.getSplits(PigInputFormat.java:268)
> ... 7 more
>
>
> where is the default path of the data.txt configured ?
>
> Regards
> Kiran.G
>
> -----Original Message-----
> From: Marek Miglinski
> Sent: Monday, September 19, 2011 3:14 PM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> hadoop fs -ls /
>
> BACKSHASH at the end!
>
> And:
> A= LOAD '/data/test.txt' USING PigStorage();
>
> BACKSLASH before data!
>
>
> -----Original Message-----
> From: kiranprasad [mailto:[EMAIL PROTECTED]]
> Sent: Monday, September 19, 2011 12:10 PM
> To: [EMAIL PROTECTED]
> Subject: Re: ERROR 2118: Input path does not exist
>
> Hi
>
> I am unable t run the below mentioned command : hadoop fs -ls getting the
> same output.
>
> [kiranprasad.g@pig4 hadoop-0.20.2]$ bin/hadoop fs -ls
> ls: Cannot access .: No such file or directory.
>
> Below is the exception.
> Message: org.apache.pig.backend.executionengine.ExecException: ERROR 2118:
> Input path does not exist:
> hdfs://10.0.0.61/home/kiranprasad.g/pig-0.8.1/data/msisdns.txt
>
> Regards
> Kiran.G
>
> -----Original Message-----
> From: Marek Miglinski
> Sent: Sunday, September 18, 2011 1:09 AM
> To: [EMAIL PROTECTED]
> Subject: RE: ERROR 2118: Input path does not exist
>
> I meant that you should use absolute path when you load HDFS path from PIG,