Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> How to speed up Scan -- please help


Copy link to this message
-
Re: How to speed up Scan -- please help
What "vmstat 1" shows?
Does gzip family used?

2010/9/13 Jian Lu <[EMAIL PROTECTED]>:
> Hi All,
>
> I am pulling my hair off here because the Scan takes 40 sec to scan 750,000 records.  I am running HBase 0.20.4 on standalone mode on Linux with 16 GB RAM, 64-bit CPU/Operating system/JVM.  My table is very simple with one family and five columns, each column contains very small String (employee name, address, etc.).
>
> Below is my configuration.  Could you all please tell me what I missed?
>
> config.set("hbase.client.pause", "10000");
> config.set("hbase.client.retries.number", "100");
> config.set("hbase.client.scanner.caching", "10000");
>
> table.setScannerCaching(10000);
>
> scan.setCaching(10000);
> scan.setCacheBlocks(false);
>
>
> Thanks a lot!
> Jack.
>