Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Recursive directory as input from s3


Copy link to this message
-
Recursive directory as input from s3
Jeremy Katz 2012-12-12, 02:12
While the mapred.input.dir.recursive setting claims to allow recursing all
the files within a directory tree being used as an input of a job[1], it
doesn't seem to be working for me when using s3 to store the input.  Has
anyone else seen this and worked around (or had it work, in which case
maybe something else is going wrong with my jobs and I'll dig some more)?

Thanks,

- Jeremy

[1] https://issues.apache.org/jira/browse/MAPREDUCE-1501