Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> Hbase import Tsv performance (slow import)


Copy link to this message
-
Re: Hbase import Tsv performance (slow import)
Hi Nick,

Do you see anything in your tasktracker or datanode logs?

Best Regards,
Sonal
Crux: Reporting for HBase <https://github.com/sonalgoyal/crux>
Nube Technologies <http://www.nubetech.co>

<http://in.linkedin.com/in/sonalgoyal>

On Wed, Oct 24, 2012 at 3:45 PM, Nick maillard <
[EMAIL PROTECTED]> wrote:

> As I have written in a reply above but that is kind of lost in the tread:
>
> I have set dfs.replication at 2 but this process time has not changed at
> all.
> How could I change my configuration to avoid this hotspot issue you have
> talked
> about.
>
> As Kevin has advised I have also upped:
> hbase.hstore.blockingStoreFiles to 100
> hbase.hregion.memstore.block.multiplier to 7
> hbase.hregion.memstore.flush.size to 256 MB
> hbase.regionserver.optionallogflushinterval to 30s
>
> These changes did not bring any significant evolution in speed.
>
> My cluster is 3 ubuntu machines:
>  2 cores 4 threads 3.4+ GHz with 16gb ram
>
> thanks for everyones help
>
>
>