MapReduce, mail # user - Setting Config Property in OutputFormat.checkOutputSpecs().

Setting Config Property in OutputFormat.checkOutputSpecs().

Jane Chen 2011-05-20, 18:24

I need to save some data in the job config as part of OutputFormat.checkOutputSpecs(), and have it propagated to map tasks. It seems that the property is saved correctly when OutputFormat.checkOutputSpecs() is run, but it can't be found in the map tasks. Any idea why that's the case?

Thanks,
Jane

Re: Setting Config Property in OutputFormat.checkOutputSpecs().

Harsh J 2011-05-21, 17:08

Which version of Hadoop are you on?

This ought to work as long as you're making configuration changes
directly into the JobConf reference the OutputFormat gets passed to.
How're you doing the changes?

On Fri, May 20, 2011 at 11:54 PM, Jane Chen <[EMAIL PROTECTED]> wrote:
> I need to save some data in the job config as part of OutputFormat.checkOutputSpecs(), and have it propagated to map tasks. It seems that the property is saved correctly when OutputFormat.checkOutputSpecs() is run, but it can't be found in the map tasks. Any idea why that's the case?
>
> Thanks,
> Jane
>

--
Harsh J