Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # dev >> Facing problem with Hadoop M/R Code setup


Copy link to this message
-
Facing problem with Hadoop M/R Code setup
Hi,
I am newbie to Hadoop M/R. My Problem is:

I have a file(.txt) in hdfs location which contains 5 lines. Each line
represents a hdfs location. Now, I want to read the lines inside Mapper
class and in the Reducer I want to actually work on those files and zip
them using some utility. The zip is the final product which I wish to have.

I had written a standalone code using Hadoop api. But I am out of wits
regarding scaling this program on top of MR.

Please help. Thanks in Advance

--
Thanks,
*Shouvanik*
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB