Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Hbase import Tsv performance (slow import)


Copy link to this message
-
Re: Hbase import Tsv performance (slow import)
Hi Nick,

Do you see anything in your tasktracker or datanode logs?

Best Regards,
Sonal
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>

On Wed, Oct 24, 2012 at 3:45 PM, Nick maillard <
[EMAIL PROTECTED]> wrote:

> As I have written in a reply above but that is kind of lost in the tread:
>
> I have set dfs.replication at 2 but this process time has not changed at
> all.
> How could I change my configuration to avoid this hotspot issue you have
> talked
> about.
>
> As Kevin has advised I have also upped:
> hbase.hstore.blockingStoreFiles to 100
> hbase.hregion.memstore.block.multiplier to 7
> hbase.hregion.memstore.flush.size to 256 MB
> hbase.regionserver.optionallogflushinterval to 30s
>
> These changes did not bring any significant evolution in speed.
>
> My cluster is 3 ubuntu machines:
>  2 cores 4 threads 3.4+ GHz with 16gb ram
>
> thanks for everyones help
>
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB