Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> M/R scan problem


Copy link to this message
-
Re: M/R scan problem
Did a quick trim...

Sorry to jump in on the tail end of this...
Two things you may want to look at...

Are you timing out because you haven't updated your status within the task or are you taking 600seconds to complete a single map() iteration.

You can test this by tracking to see how long you are spending in each map iteration and printing out the result if it is longer than 2 mins...

Also try updating your status in each iteration by sending a unique status update like current system time...
...
Sent from a remote device. Please excuse any typos...

Mike Segel

On Jul 4, 2011, at 12:35 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Although connection count may not be the root cause, please read
> http://zhihongyu.blogspot.com/2011/04/managing-connections-in-hbase-090-and.htmlif
> you have time.
> 0.92.0 would do a much better job of managing connections.
>
> On Mon, Jul 4, 2011 at 10:14 AM, Lior Schachter <[EMAIL PROTECTED]> wrote:
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB