Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: Running hadoop on directory structure


Copy link to this message
-
Re: Running hadoop on directory structure
Here is a possible solution

To add a root directory structure such as the following

as InputPath, do the following
For the output to mirror the input and to build based on Harsh J's response

You might be able to not use a reducer and use the MultipleOutput from the
mapper directly.

--
View this message in context: http://hadoop.6.n7.nabble.com/Running-hadoop-on-directory-structure-tp67904p68110.html
Sent from the common-user mailing list archive at Nabble.com.
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB