Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Sending data to all reducers

Copy link to this message
Re: Sending data to all reducers

I would recommend taking a relook at your current algorithm and making sure
you are utilizing the MR framework to its strengths. You can evaluate
having multiple passes for your map reduce program, or doing a map side
join. You mention runtime is important for your system, so make sure you
preserve data locality in the generated tasks.


Best Regards,
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>


On Thu, Aug 23, 2012 at 6:50 PM, Hamid Oliaei <[EMAIL PROTECTED]> wrote:

> Hi,
> I take a look to that, hope it can be useful for my purpose.
> Thank you so much.
> Hamid