-Re: Partition classes, how to pass in background information
Jane Wayne 2012-03-14, 23:42
Thanks Chris! That worked!
On Wed, Mar 14, 2012 at 6:06 AM, Chris White <[EMAIL PROTECTED]>wrote:
> If your class implements the configurable interface, hadoop will call the
> setConf method after creating the instance. Look in the source code for
> ReflectionUtils.newInstance for more info
> On Mar 14, 2012 2:31 AM, "Jane Wayne" <[EMAIL PROTECTED]> wrote:
> > i am using the new org.apache.hadoop.mapreduce.Partitioner class.
> > i need to pass it some background information. how can i do this?
> > in the old, org.apache.hadoop.mapred.Partitioner class (now deprecated),
> > this class extends JobConfigurable, and it seems the "hook" to pass in
> > background data is with the JobConfigurable.configure(JobConf job)
> > i thought that if i sub-classed org.apache.hadoop.mapreduce.Partitioner,
> > could pass in the background information, however, in the
> > org.apache.hadoop.mapreduce.Job class, it only has a
> > setPartitionerClass(Class<? extends Partitioner>) method.
> > all my development has been the new mapreduce package, and i would
> > definitely desire to stick with the new API/package. any help is
> > appreciated.