Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Program trying to read from local instead of hdfs

Copy link to this message
Program trying to read from local instead of hdfs
  I am not sure what I am doing wrong.
I copy my input files from local to hdfs at local


In my driver code: I have
 MultipleInputs.addInputPath(conf, new Path(args[0]),
TextInputFormat.class, UserFileMapper.class);
              MultipleInputs.addInputPath(conf, new Path(args[1]),
TextInputFormat.class, DeliveryFileMapper.class);

And then when i try to run the code I get an error:
Exception in thread "main" java.io.FileNotFoundException: File
/user/hduser/data/input1.txt does not exist.

And lets say on my local I have the path as
And then when I try to run the file it throws an error
13/01/17 15:26:06 INFO mapred.JobClient: Cleaning up the staging area
13/01/17 15:26:06 ERROR security.UserGroupInformation:
PriviledgedActionException as:mhduser
cause:org.apache.hadoop.mapred.InvalidInputException: Input path does not
exist: hdfs://localhost:54310/Users/local/project/input1.txt

Well offcourse, its not in there.. its on my local.
So when I give the hdfs localtion.. it reads thru local and when i give my
local location.. it is pointing to hdfs..
What am I doing wrong?
For reference, I am trying to run this code: