Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Passing an Object to All Reducers

Copy link to this message
Re: Passing an Object to All Reducers
If possible serialize the object as XML then add it as a set of lines to the
config - alternatively serialize it (maybe xml) to a known spot in HDFS and
read it in in the setup code in the reducer - I assume this is an object
known at the start of the job and not modified by the mapper

On Fri, May 6, 2011 at 10:12 AM, Geoffry Roberts

> All,
> I need for each one of my reducers to have read access to a certain object
> or a clone thereof.  I can instantiate this object a start up.  How can I
> give my reducers a copy?
> --
> Geoffry Roberts
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com