Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Sending data to all reducers


+
Hamid Oliaei 2012-08-23, 08:41
Copy link to this message
-
Re: Sending data to all reducers
So you are trying to run a single reducer on each machine, and all input
data regardless of its location gets streamed to each reducer?

On Thu, Aug 23, 2012 at 10:41 AM, Hamid Oliaei <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I want to broadcast some data to all nodes under Hadoop 0.20.2. I tested
> DistributedCache module. Unfortunately, it was time-consuming
> and runtime is important for my work.
> I want to write a MR job so that a copy of input data are generated in
> output of all reducers.
> Is that possible? How?
> I mean I want to have copies of some data to the number of reducers.
>
> Thanks,
>
> Hamid Oliaei
>
> [EMAIL PROTECTED]
>
>
+
Hamid Oliaei 2012-08-23, 08:47
+
Tim Robertson 2012-08-23, 10:05
+
Hamid Oliaei 2012-08-23, 11:08
+
Tim Robertson 2012-08-23, 13:14
+
Hamid Oliaei 2012-08-23, 13:20
+
Sonal Goyal 2012-08-23, 13:37