Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> Multiple file output


Copy link to this message
-
Re: Multiple file output
Note that org.apache.hadoop.mapreduce.lib.output.MultipleOutputs is
scheduled for the next CDH 0.20 release -- ready "soon."
- Aaron

2010/1/6 Amareshwari Sri Ramadasu <[EMAIL PROTECTED]>

> No. It is part of branch 0.21 onwards. For 0.20*, people can use old api
> only, though JobConf is deprecated.
>
> -Amareshwari.
>
> On 1/6/10 11:52 AM, "Vijay" <[EMAIL PROTECTED]> wrote:
>
> org.apache.hadoop.mapreduce.lib.output.MultipleOutputs is not part of the
> released version of 0.20.1 right? Is this expected to be part of 0.20.2 or
> later?
>
>
> 2010/1/5 Amareshwari Sri Ramadasu <[EMAIL PROTECTED]>
>
> > In branch 0.21, You can get the functionality of both
> > org.apache.hadoop.mapred.lib.MultipleOutputs and
> > org.apache.hadop.mapred.lib.MultipleOutputFormat in
> > org.apache.hadoop.mapreduce.lib.output.MultipleOutputs. Please see
> > MAPREDUCE-370 for more details.
> >
> > Thanks
> > Amareshwari
> >
> > On 1/5/10 5:56 PM, "松柳" <[EMAIL PROTECTED]> wrote:
> >
> > I'm afraid you have to write it by yourself, since there are no
> equivalent
> > classes in new API.
> >
> > 2009/12/28 Huazhong Ning <[EMAIL PROTECTED]>
> >
> > > Hi all,
> > >
> > > I need your help on multiple file output. I have many big files and I
> > hope
> > > the processing result of each file is outputted to a separate file. I
> > know
> > > in the old Hadoop APIs, the class MultipleOutputFormat works for this
> > > propose. But I cannot find the same class in new APIs. Does anybody
> know
> > in
> > > the new APIs how to solve this problem?
> > > Thanks a lot.
> > >
> > > Ning, Huazhong
> > >
> > >
> > >
> >
> >
>
>