Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> HBase bulk loader doing speculative execution when it set to false in mapred-site.xml


Copy link to this message
-
Re: HBase bulk loader doing speculative execution when it set to false in mapred-site.xml
Thanks for the quick reply, Jean. Is there any link where i can find the
name of all client-side configuration for HBase?

~Anil

On Fri, Mar 30, 2012 at 3:01 PM, Jean-Daniel Cryans <[EMAIL PROTECTED]>wrote:

> This is a client-side configuration so if your mapred-site.xml is
> _not_ on your classpath when you start the bulk load, it's not going
> to pick it up. So either have that file on your classpath, or put it
> in whatever other configuration file you have.
>
> J-D
>
> On Fri, Mar 30, 2012 at 2:52 PM, anil gupta <[EMAIL PROTECTED]> wrote:
> > Hi All,
> >
> > I am using cdh3u2. I ran HBase bulk loading with property
> > "mapred.reduce.tasks.speculative.execution" set to "false" in
> > mapred-site.xml. Still, i can see 6 killed task in Bulk Loading job and
> > after short analysis i realized that these jobs are killed because
> another
> > worker node completed the task, hence it means that speculative execution
> > is still on. Why the HBase Bulk loader is doing speculative execution
> when
> > i have set it to false in mapred-site.xml? Please let me know if i am
> > missing something over here.
> >
> > --
> > Thanks & Regards,
> > Anil Gupta
>

--
Thanks & Regards,
Anil Gupta
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB