|
|
-
Meaure server time of Get/Scan - through RPC logging?
Wei Tan 2012-12-02, 17:21
Hi I am using YCSB to measure the performance of some complex Get/Scan, i.e., with some filters. I found that I got weird high latency from YCSB client but both HBase server and YCSB client are NOT saturated (in terms of network, I/O, CPU). So I want to measure the server time a single Get/Scan takes.
Is there a way to do it? From the documentation it seems that RPC logging is a place to look but the semantics of the logging is not well-documented so I wonder 1) if RPC logging is the right approach and 2) how I can interpret it correctly. Thanks! Best Regards, Wei
+
Wei Tan 2012-12-02, 17:21
-
Re: Meaure server time of Get/Scan - through RPC logging?
Wei Tan 2012-12-09, 02:41
Hmm... I appreciate it if anybody can point me how to measure server side Get/Scan time... Thanks! Best Regards, Wei From: Wei Tan/Watson/IBM To: [EMAIL PROTECTED], Date: 12/02/2012 12:21 PM Subject: Meaure server time of Get/Scan - through RPC logging? Hi I am using YCSB to measure the performance of some complex Get/Scan, i.e., with some filters. I found that I got weird high latency from YCSB client but both HBase server and YCSB client are NOT saturated (in terms of network, I/O, CPU). So I want to measure the server time a single Get/Scan takes.
Is there a way to do it? From the documentation it seems that RPC logging is a place to look but the semantics of the logging is not well-documented so I wonder 1) if RPC logging is the right approach and 2) how I can interpret it correctly. Thanks! Best Regards, Wei
+
Wei Tan 2012-12-09, 02:41
-
Re: Meaure server time of Get/Scan - through RPC logging?
Asaf Mesika 2012-12-09, 10:12
The scan are done in parallel in many region servers and are specific to your query, so I don't think any jmx counter can help you. Maybe you measure it using your own Region Observer on Pre/Post Scan, and writing it to a shared log file on hdfs.
Sent from my iPhone
On 9 בדצמ 2012, at 04:41, Wei Tan <[EMAIL PROTECTED]> wrote:
> Hmm... I appreciate it if anybody can point me how to measure server side > Get/Scan time... Thanks! > > > Best Regards, > Wei > > > > > From: Wei Tan/Watson/IBM > To: [EMAIL PROTECTED], > Date: 12/02/2012 12:21 PM > Subject: Meaure server time of Get/Scan - through RPC logging? > > > Hi I am using YCSB to measure the performance of some complex Get/Scan, > i.e., with some filters. I found that I got weird high latency from YCSB > client but both HBase server and YCSB client are NOT saturated (in terms > of network, I/O, CPU). So I want to measure the server time a single > Get/Scan takes. > > Is there a way to do it? From the documentation it seems that RPC logging > is a place to look but the semantics of the logging is not well-documented > so I wonder 1) if RPC logging is the right approach and 2) how I can > interpret it correctly. > > > Thanks! > > > Best Regards, > Wei >
+
Asaf Mesika 2012-12-09, 10:12
|
|