Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce, mail # user - MapReduce on Local FileSystem


+
Agarwal, Nikhil 2013-05-31, 06:37
+
Rahul Bhattacharjee 2013-05-31, 07:03
+
Agarwal, Nikhil 2013-05-31, 07:12
+
Rahul Bhattacharjee 2013-05-31, 07:14
+
Kun Ling 2013-06-04, 06:48
+
Agarwal, Nikhil 2013-05-31, 07:24
Copy link to this message
-
Re: MapReduce on Local FileSystem
Harsh J 2013-05-31, 07:25
Then why not simply run with Write Replication Factor set to 1?

On Fri, May 31, 2013 at 12:54 PM, Agarwal, Nikhil
<[EMAIL PROTECTED]> wrote:
> Hi,
>
>
>
> Thank you for your reply. One simple answer can be to reduce the time taken
> for ingesting the data in HDFS.
>
>
>
> Regards,
>
> Nikhil
>
>
>
> From: Sanjay Subramanian [mailto:[EMAIL PROTECTED]]
> Sent: Friday, May 31, 2013 12:50 PM
> To: <[EMAIL PROTECTED]>
> Cc: [EMAIL PROTECTED]
>
>
> Subject: Re: MapReduce on Local FileSystem
>
>
>
> Basic question. Why would u want to do that ? Also I think the Map R Hadoop
> distribution has an NFS mountable HDFS
>
> Sanjay
>
> Sent from my iPhone
>
>
> On May 30, 2013, at 11:37 PM, "Agarwal, Nikhil" <[EMAIL PROTECTED]>
> wrote:
>
> Hi,
>
>
>
> Is it possible to run MapReduce on multiple nodes using Local File system
> (file:///)  ?
>
> I am able to run it in single node setup but in a multiple node setup the
> “slave” nodes are not able to access the “jobtoken” file which is present in
> the Hadoop.tmp.dir in “master” node.
>
>
>
> Please let me know if it is possible to do this.
>
>
>
> Thanks & Regards,
>
> Nikhil
>
>
>
> CONFIDENTIALITY NOTICE
> =====================> This email message and any attachments are for the exclusive use of the
> intended recipient(s) and may contain confidential and privileged
> information. Any unauthorized review, use, disclosure or distribution is
> prohibited. If you are not the intended recipient, please contact the sender
> by reply email and destroy all copies of the original message along with any
> attachments, from your computer system. If you are the intended recipient,
> please be advised that the content of this message is subject to access,
> review and disclosure by the sender's Email System Administrator.

--
Harsh J
+
王洪军 2013-05-31, 10:14
+
Sanjay Subramanian 2013-05-31, 16:09