Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - M/R scan problem


Copy link to this message
-
Re: M/R scan problem
Michel Segel 2011-07-04, 19:36
Did a quick trim...

Sorry to jump in on the tail end of this...
Two things you may want to look at...

Are you timing out because you haven't updated your status within the task or are you taking 600seconds to complete a single map() iteration.

You can test this by tracking to see how long you are spending in each map iteration and printing out the result if it is longer than 2 mins...

Also try updating your status in each iteration by sending a unique status update like current system time...
...
Sent from a remote device. Please excuse any typos...

Mike Segel

On Jul 4, 2011, at 12:35 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Although connection count may not be the root cause, please read
> http://zhihongyu.blogspot.com/2011/04/managing-connections-in-hbase-090-and.htmlif
> you have time.
> 0.92.0 would do a much better job of managing connections.
>
> On Mon, Jul 4, 2011 at 10:14 AM, Lior Schachter <[EMAIL PROTECTED]> wrote:
>>