i am using the new org.apache.hadoop.mapreduce.Partitioner class. however,
i need to pass it some background information. how can i do this?

in the old, org.apache.hadoop.mapred.Partitioner class (now deprecated),
this class extends JobConfigurable, and it seems the "hook" to pass in any
background data is with the JobConfigurable.configure(JobConf job) method.

i thought that if i sub-classed org.apache.hadoop.mapreduce.Partitioner, i
could pass in the background information, however, in the
org.apache.hadoop.mapreduce.Job class, it only has a
setPartitionerClass(Class<? extends Partitioner>) method.

all my development has been the new mapreduce package, and i would
definitely desire to stick with the new API/package. any help is
appreciated.

If your class implements the configurable interface, hadoop will call the
setConf method after creating the instance. Look in the source code for
ReflectionUtils.newInstance for more info
On Mar 14, 2012 2:31 AM, "Jane Wayne" <[EMAIL PROTECTED]> wrote:

> i am using the new org.apache.hadoop.mapreduce.Partitioner class. however,
> i need to pass it some background information. how can i do this?
>
> in the old, org.apache.hadoop.mapred.Partitioner class (now deprecated),
> this class extends JobConfigurable, and it seems the "hook" to pass in any
> background data is with the JobConfigurable.configure(JobConf job) method.
>
> i thought that if i sub-classed org.apache.hadoop.mapreduce.Partitioner, i
> could pass in the background information, however, in the
> org.apache.hadoop.mapreduce.Job class, it only has a
> setPartitionerClass(Class<? extends Partitioner>) method.
>
> all my development has been the new mapreduce package, and i would
> definitely desire to stick with the new API/package. any help is
> appreciated.
>

Thanks Chris! That worked!

On Wed, Mar 14, 2012 at 6:06 AM, Chris White <[EMAIL PROTECTED]>wrote:

> If your class implements the configurable interface, hadoop will call the
> setConf method after creating the instance. Look in the source code for
> ReflectionUtils.newInstance for more info
> On Mar 14, 2012 2:31 AM, "Jane Wayne" <[EMAIL PROTECTED]> wrote:
>
> > i am using the new org.apache.hadoop.mapreduce.Partitioner class.
> however,
> > i need to pass it some background information. how can i do this?
> >
> > in the old, org.apache.hadoop.mapred.Partitioner class (now deprecated),
> > this class extends JobConfigurable, and it seems the "hook" to pass in
> any
> > background data is with the JobConfigurable.configure(JobConf job)
> method.
> >
> > i thought that if i sub-classed org.apache.hadoop.mapreduce.Partitioner,
> i
> > could pass in the background information, however, in the
> > org.apache.hadoop.mapreduce.Job class, it only has a
> > setPartitionerClass(Class<? extends Partitioner>) method.
> >
> > all my development has been the new mapreduce package, and i would
> > definitely desire to stick with the new API/package. any help is
> > appreciated.
> >
>