Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Accumulo, mail # user - Chain Jobs and Accumulo.


Copy link to this message
-
Re: Chain Jobs and Accumulo.
William Slacum 2012-07-16, 21:52
mapred was deprecated as of 0.20.0 (
http://hadoop.apache.org/common/docs/r0.20.0/api/org/apache/hadoop/mapred/InputFormat.html)
:)

On Mon, Jul 16, 2012 at 2:49 PM, Juan Moreno
<[EMAIL PROTECTED]>wrote:

> The hadoop API is very confusing in that regard. Currently Accumulo runs
> atop 0.20 and in that version , mapred is the new one and mapreduce is the
> old one. InputFormat currently makes use of mapreduce.
> On Jul 16, 2012 5:40 PM, "Billie J Rinaldi" <[EMAIL PROTECTED]>
> wrote:
>
>> On Monday, July 16, 2012 5:27:09 PM, "Ed Kohlwey" <[EMAIL PROTECTED]>
>> wrote:
>> > I would suggest spending the effort porting chainmapper to the new API
>> > (mapreduce) since the old API will eventually be removed.
>>
>> I assumed that would be true since the old API was deprecated, and that
>> is why we no longer support it.  However, the old API has been undeprecated
>> since 0.20.205.0 and 1.0.0, which seems to indicate it's not going away.
>>  Does anyone know what the plan for it is?
>>
>> Billie
>>
>>
>> > Sent from my smartphone. Please excuse any typos or shorthand.
>> > On Jul 16, 2012 5:22 PM, "Billie J Rinaldi" <
>> > [EMAIL PROTECTED] > wrote:
>> >
>> >
>> > On Monday, July 16, 2012 5:02:52 PM, "Juan Moreno" <
>> > [EMAIL PROTECTED] > wrote:
>> > > Hi there, I have a use case where I need to use a Chain Mapper
>> > > and/or
>> > > Reducer. The problem is that
>> > > the AccumuloInputFormat extends hadoop.mapreduce.InputFormat rather
>> > > than implementing hadoop.mapred.InputFormat
>> > >
>> > >
>> > > Trying to make use of org.apache.hadoop.mapred.lib.ChainMapper
>> > > does not work because it requires the use of the mapred package. Is
>> > > there a version of the AccumuloInputFormat which uses
>> > > the hadoop.mapred package instead? Can InputFormatBase be rewritten
>> > > with the newer API?
>> > >
>> > >
>> > > Thanks!
>> > > Juan
>> >
>> > I opened ACCUMULO-695 to add support for the old mapred API.
>> >
>> > Billie
>>
>