-Re: Most efficient way to support shared content among all mappers
Jeff Hammerbacher 2009-05-09, 20:31
For a more detailed discussion of how to use memcached for this purpose, see
the paper "Low-Latency, High-Throughput Access to Static Global Resources
within the Hadoop Framework":
On Fri, May 8, 2009 at 2:49 PM, jason hadoop <[EMAIL PROTECTED]> wrote:
> Most of the people with this need are using some variant of memcached, or
> other distributed hash table.
> On Fri, May 8, 2009 at 10:07 AM, Joe <[EMAIL PROTECTED]> wrote:
> > Hi,
> > As a newcomer to Hadoop, I wonder any efficient way to support shared
> > content among all mappers. For example, to implement an neural network
> > algorithm, I want the NN data structure accessible by all mappers.
> > Thanks for your comments!
> > - Joe
> Alpha Chapters of my book on Hadoop are available
> www.prohadoopbook.com a community for Hadoop Professionals