Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> How to speed up Scan -- please help


Copy link to this message
-
Re: How to speed up Scan -- please help
What "vmstat 1" shows?
Does gzip family used?

2010/9/13 Jian Lu <[EMAIL PROTECTED]>:
> Hi All,
>
> I am pulling my hair off here because the Scan takes 40 sec to scan 750,000 records.  I am running HBase 0.20.4 on standalone mode on Linux with 16 GB RAM, 64-bit CPU/Operating system/JVM.  My table is very simple with one family and five columns, each column contains very small String (employee name, address, etc.).
>
> Below is my configuration.  Could you all please tell me what I missed?
>
> config.set("hbase.client.pause", "10000");
> config.set("hbase.client.retries.number", "100");
> config.set("hbase.client.scanner.caching", "10000");
>
> table.setScannerCaching(10000);
>
> scan.setCaching(10000);
> scan.setCacheBlocks(false);
>
>
> Thanks a lot!
> Jack.
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB