Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Multiple file output


Copy link to this message
-
Re: Multiple file output
Note that org.apache.hadoop.mapreduce.lib.output.MultipleOutputs is
scheduled for the next CDH 0.20 release -- ready "soon."
- Aaron

2010/1/6 Amareshwari Sri Ramadasu <[EMAIL PROTECTED]>

> No. It is part of branch 0.21 onwards. For 0.20*, people can use old api
> only, though JobConf is deprecated.
>
> -Amareshwari.
>
> On 1/6/10 11:52 AM, "Vijay" <[EMAIL PROTECTED]> wrote:
>
> org.apache.hadoop.mapreduce.lib.output.MultipleOutputs is not part of the
> released version of 0.20.1 right? Is this expected to be part of 0.20.2 or
> later?
>
>
> 2010/1/5 Amareshwari Sri Ramadasu <[EMAIL PROTECTED]>
>
> > In branch 0.21, You can get the functionality of both
> > org.apache.hadoop.mapred.lib.MultipleOutputs and
> > org.apache.hadop.mapred.lib.MultipleOutputFormat in
> > org.apache.hadoop.mapreduce.lib.output.MultipleOutputs. Please see
> > MAPREDUCE-370 for more details.
> >
> > Thanks
> > Amareshwari
> >
> > On 1/5/10 5:56 PM, "松柳" <[EMAIL PROTECTED]> wrote:
> >
> > I'm afraid you have to write it by yourself, since there are no
> equivalent
> > classes in new API.
> >
> > 2009/12/28 Huazhong Ning <[EMAIL PROTECTED]>
> >
> > > Hi all,
> > >
> > > I need your help on multiple file output. I have many big files and I
> > hope
> > > the processing result of each file is outputted to a separate file. I
> > know
> > > in the old Hadoop APIs, the class MultipleOutputFormat works for this
> > > propose. But I cannot find the same class in new APIs. Does anybody
> know
> > in
> > > the new APIs how to solve this problem?
> > > Thanks a lot.
> > >
> > > Ning, Huazhong
> > >
> > >
> > >
> >
> >
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB