Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # user - execute mapreduce job on multiple hdfs files

Copy link to this message
execute mapreduce job on multiple hdfs files
Oleg Ruchovets 2010-03-23, 10:18
Hi ,
All examples that I found executes mapreduce job on a single file but in my
situation I have more than one.

Suppose I have such folder on HDFS which contains some files:

How can I execute  hadoop mapreduce on file1.txt , file2.txt and file3.txt?

Is it possible to provide to hadoop job folder as parameter and all files
will be produced by mapreduce job?

Thanks In Advance
Gang Luo 2010-03-23, 12:55
Amogh Vasekar 2010-03-23, 15:36