Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Reducer - getMapOutput


Copy link to this message
-
Re: Reducer - getMapOutput
Hey Robert,

 Can you pls share what you are trying to do?

Arun

On Jul 30, 2012, at 9:10 AM, Grandl Robert wrote:

> Hi,
>
> I am trying to modify the code for data transfer of intermediate output.
>
> In this respect, on the reduce side in getMapOuput I want to have the connection with the TaskTracker(setupSecureConnection), but then on doGet the TaskTracker to be able to delay the response back to the client. I tried with Thread.sleep(time), before setting up the response.setHeader(FROM_MAP_TASK, mapId) and the subsequent headers/content. But it seems the reducer will continue to read the headers immediately and get NULL.
>
> Do you know how can I do the reducer to wait for TaskTracker to update this information before reading it. I tried with a while loop and reading the connection.getHeaderField(...) till not null but seems it always remains in the loop :(.
>
> Probably is more a HttpServlet related problem but I am not very familiar with that.
>
> Do you have any idea how can I do it ?
>
> Thanks,
> Robert

--
Arun C. Murthy
Hortonworks Inc.
http://hortonworks.com/