Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS, mail # user - Can I perfrom a MR on my local filesystem


Copy link to this message
-
Can I perfrom a MR on my local filesystem
Agarwal, Nikhil 2013-02-17, 06:22
Hi,
Recently I followed a blog to run Hadoop on a single node cluster.

I wanted to ask that in a single node set-up of Hadoop is it necessary to have the data copied into Hadoop's HDFS before running a MR on it. Can I run MR on my local file system too without copying the data to HDFS?

In the Hadoop source code I saw there are implementations of other file systems too like S3, KFS, FTP, etc. so how does exactly a MR happen on S3 data store ? How does JobTracker or Tasktracker run in S3 ?

I would be very thankful to get a reply to this.

Thanks & Regards,

Nikhil

+
Nitin Pawar 2013-02-17, 07:50
+
Niels Basjes 2013-02-17, 07:47
+
Agarwal, Nikhil 2013-02-17, 11:18