Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Passing an Object to All Reducers


Copy link to this message
-
Re: Passing an Object to All Reducers
On 05/06/2011 01:12 PM, Geoffry Roberts wrote:
> All,
>
> I need for each one of my reducers to have read access to a certain object
> or a clone thereof.  I can instantiate this object a start up.  How can I
> give my reducers a copy?

Serialize it to a string, set it as a configuration setting on the job's
configuration, then have each reducer read it from out of the config
setting, and deserialize the object.

HTH,

DR
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB