Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # dev >> Issue HADOOP-8905


Copy link to this message
-
Re: Issue HADOOP-8905
Quoting Steve Loughran <[EMAIL PROTECTED]>:

> On 8 May 2013 21:20, <[EMAIL PROTECTED]> wrote:
>
>> Hi Harsh,
>>
>> Thanks for responding,
>>
>> I would be interested in what the dev group had in mind for this and I
>> also have a couple of additional queries ;
>>
>> I can see that a quick win for this would be to expose the existing Jetty
>> statistics metrics within the jetty-management api/
>>
>> Existing metrics which can be exposed include without much effort include;
>>
>> statsOnMs: Time in milliseconds stats have been collected for.
>> statsReset(): Reset statistics.
>> requests: Number of requests since statsReset() called.
>> requestsActive: Number of requests currently active.
>> requestsActiveMin: Minimum number of active requests since statsReset()
>> called.
>> requestsActiveMax: Maximum number of active requests since statsReset()
>> called.
>> requestsDurationAve: Average duration of request handling in milliseconds
>> since statsReset() called.
>> requestsDurationMin: Get minimum duration in milliseconds of request
>> handling since statsReset() called.
>> requestsDurationMax: Get maximum duration in milliseconds of request
>> handling since statsReset() called.
>> requestsDurationTotal: Get total duration in milliseconds of all request
>> handling since statsReset() called.
>>
>>
> I have some code on a not-yet-merged fork to create duruations, build
> rolling average and variance, that variance being a key one if you are
> trying to serve end users; ave can hide problems. There's Duration,
> DurationStats to aggregate stats, and a DurationTable to map to duration
> stats by name, e.g. "POST", and whether the op passed or failed
>
> Unless there are existing bits of this stuff lurking somewhere in the
> Hadoop codebase that I haven't noticed, these could be copied into hadoop
> core. Reviewing the code as it is would be welcome
>
> https://github.com/steveloughran/hadoop-trunk/tree/stevel/HADOOP-8545-swift/hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util
>

Thank you Steve, if you don't mind me taking a look at and possibly  
using your stats classes with this issue that would be great.

I will review and get back in touch

Regards
S
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB