Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - MapReduce on Local FileSystem


Copy link to this message
-
RE: MapReduce on Local FileSystem
Agarwal, Nikhil 2013-05-31, 07:12
Hi Rahul,

Can you please explain what do you mean by “filer directory mounted to all the DN” ? Do you mean a NFS-mount? If yes then I want to avoid NFS-mount. With NFS-mount it is possible to do it.

Thanks & Regards,
Nikhil

From: Rahul Bhattacharjee [mailto:[EMAIL PROTECTED]]
Sent: Friday, May 31, 2013 12:33 PM
To: [EMAIL PROTECTED]
Subject: Re: MapReduce on Local FileSystem

Just a hunch. Can have a filer directory mounted to all the DN and then file:///<file:///\\> should be usuable in a distributed fashion. (Just a guess)
Thanks,
Rahul

On Fri, May 31, 2013 at 12:07 PM, Agarwal, Nikhil <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,

Is it possible to run MapReduce on multiple nodes using Local File system (file:///<file:///\\>)  ?
I am able to run it in single node setup but in a multiple node setup the “slave” nodes are not able to access the “jobtoken” file which is present in the Hadoop.tmp.dir in “master” node.

Please let me know if it is possible to do this.

Thanks & Regards,
Nikhil