Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Hadoop map-side join


Copy link to this message
-
Re: Hadoop map-side join
See https://issues.apache.org/jira/browse/MAPREDUCE-355 (not in 1.x series) -C

On Tue, Nov 13, 2012 at 8:26 AM, Guang Yang <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I'm trying to use Hadoop map-side join in my application and wondering if
> anybody knows if there's a way to use it with the new Hadoop API
> ("org.apache.hadoop.mapreduce.*") instead of the old Hadoop API
> ("org.apache.hadoop.mapred.*"). The input format I'm trying to use for the
> join is "CompositeInputFormat", which is in the old API package and looks
> like it expects everything (job configuration, input split, etc) to be from
> the old API too. This is a problem for me because I'm using the new API to
> create my map/reduce jobs so I can't just use "CompositeInputFormat" as my
> job's input format. I wonder if the only way to get the map-side join work
> is to use the old API to create map/reduce jobs. I appreciate any response
> regarding this issue.
>
> Thanks,
> Guang Yang
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB