Lars George
2012-06-15, 08:07
Stack
2012-06-15, 15:07
Andrew Purtell
2012-06-15, 15:41
Lars George
2012-06-15, 15:54
Elliott Clark
2012-06-15, 17:04
Stack
2012-06-15, 22:01
Enis Söztutar
2012-06-15, 23:47
Dave Wang
2012-06-16, 00:00
Lars George
2012-06-16, 08:27
Otis Gospodnetic
2012-06-18, 22:45
Elliott Clark
2012-06-19, 16:03
Gregory Chanan
2012-06-23, 00:23
Lars George
2012-06-23, 07:10
Alex Baranau
2012-06-29, 16:06
Lars George
2012-06-29, 17:21
Alex Baranau
2012-06-29, 20:10
Andrew Purtell
2012-06-29, 20:15
Elliott Clark
2012-06-29, 20:53
Ted Yu
2012-06-29, 21:45
Andrew Purtell
2012-06-30, 00:31
Andrew Wang
2012-06-30, 00:41
-
Metrics in 0.96Lars George 2012-06-15, 08:07
Hi,
I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
Cheers,
Lars
I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
Cheers,
Lars
-
Re: Metrics in 0.96Stack 2012-06-15, 15:07
On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>
+1 and +1 on you being Ring Master (tell us what to do!)
Some metrics are near useless.
Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
St.Ack
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>
+1 and +1 on you being Ring Master (tell us what to do!)
Some metrics are near useless.
Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
St.Ack
-
Re: Metrics in 0.96Andrew Purtell 2012-06-15, 15:41
+1
And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
- Andy
On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>
>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>
>
> +1 and +1 on you being Ring Master (tell us what to do!)
>
> Some metrics are near useless.
>
> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
> St.Ack
And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
- Andy
On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]> wrote:
>> Hi,
>>
>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>
>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>
>
> +1 and +1 on you being Ring Master (tell us what to do!)
>
> Some metrics are near useless.
>
> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
> St.Ack
-
Re: Metrics in 0.96Lars George 2012-06-15, 15:54
Hi Andy,
Yes, that is exactly the plan. I am sure we have areas where we simply lack metrics, I have noted this down somewhere and will dig up the details. It would also consolidate (and close out) all open "Improve HBase Metrics" JIRAs.
Lars
On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
> +1
>
> And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
>
> Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
>
> - Andy
>
> On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>>
>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>>
>>
>> +1 and +1 on you being Ring Master (tell us what to do!)
>>
>> Some metrics are near useless.
>>
>> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
>> St.Ack
Yes, that is exactly the plan. I am sure we have areas where we simply lack metrics, I have noted this down somewhere and will dig up the details. It would also consolidate (and close out) all open "Improve HBase Metrics" JIRAs.
Lars
On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
> +1
>
> And at the same time IMHO it's worth asking if we have everything covered with a meaningful metric, and add if missing, as well as remove those not useful.
>
> Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some point but the latest (1.0.3) has it for sure.
>
> - Andy
>
> On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]> wrote:
>>> Hi,
>>>
>>> I propose that we clean up the metrics for 0.96 as well (if that is not already underway. This includes switching to Hadoop Metrics v2 and adding all missing stats, as well as fixing those that are misleading or useless. For that reason I talked to our friends at Sematext during the Buzzwords HBase workshop, as well as to our internal HBase team. We all seem to agree and I'd be happy to setup some sort of call/task force to discuss what we need to work on etc. Obviously I would love for someone from the FB team to also partake as they have done heaps lately on that end - but I also understand if that is a timing issue.
>>>
>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would love for the metrics to be stable by then.
>>>
>>
>> +1 and +1 on you being Ring Master (tell us what to do!)
>>
>> Some metrics are near useless.
>>
>> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should be fine.
>> St.Ack
-
Re: Metrics in 0.96Elliott Clark 2012-06-15, 17:04
Sounds great.
I also think we should start moving away from just averages, and move
towards using the histograms. Right now the histograms are broken, they
don't get exported into jmx but I've got a fix I think (HBASE-6211). I
would also like to look into tying Server/Region Load in with metrics.
Right now they are very similar to
RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
overlap.
On Fri, Jun 15, 2012 at 8:54 AM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Andy,
>
> Yes, that is exactly the plan. I am sure we have areas where we simply
> lack metrics, I have noted this down somewhere and will dig up the details.
> It would also consolidate (and close out) all open "Improve HBase Metrics"
> JIRAs.
>
> Lars
>
> On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
>
> > +1
> >
> > And at the same time IMHO it's worth asking if we have everything
> covered with a meaningful metric, and add if missing, as well as remove
> those not useful.
> >
> > Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some
> point but the latest (1.0.3) has it for sure.
> >
> > - Andy
> >
> > On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
> >
> >> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]>
> wrote:
> >>> Hi,
> >>>
> >>> I propose that we clean up the metrics for 0.96 as well (if that is
> not already underway. This includes switching to Hadoop Metrics v2 and
> adding all missing stats, as well as fixing those that are misleading or
> useless. For that reason I talked to our friends at Sematext during the
> Buzzwords HBase workshop, as well as to our internal HBase team. We all
> seem to agree and I'd be happy to setup some sort of call/task force to
> discuss what we need to work on etc. Obviously I would love for someone
> from the FB team to also partake as they have done heaps lately on that end
> - but I also understand if that is a timing issue.
> >>>
> >>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would love for the metrics to be stable by then.
> >>>
> >>
> >> +1 and +1 on you being Ring Master (tell us what to do!)
> >>
> >> Some metrics are near useless.
> >>
> >> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should
> be fine.
> >> St.Ack
>
>
I also think we should start moving away from just averages, and move
towards using the histograms. Right now the histograms are broken, they
don't get exported into jmx but I've got a fix I think (HBASE-6211). I
would also like to look into tying Server/Region Load in with metrics.
Right now they are very similar to
RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
overlap.
On Fri, Jun 15, 2012 at 8:54 AM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Andy,
>
> Yes, that is exactly the plan. I am sure we have areas where we simply
> lack metrics, I have noted this down somewhere and will dig up the details.
> It would also consolidate (and close out) all open "Improve HBase Metrics"
> JIRAs.
>
> Lars
>
> On Jun 15, 2012, at 5:41 PM, Andrew Purtell wrote:
>
> > +1
> >
> > And at the same time IMHO it's worth asking if we have everything
> covered with a meaningful metric, and add if missing, as well as remove
> those not useful.
> >
> > Metrics2 is in Hadoop core 1 and 2. There was a backport into 1 at some
> point but the latest (1.0.3) has it for sure.
> >
> > - Andy
> >
> > On Jun 15, 2012, at 8:07 AM, Stack <[EMAIL PROTECTED]> wrote:
> >
> >> On Fri, Jun 15, 2012 at 1:07 AM, Lars George <[EMAIL PROTECTED]>
> wrote:
> >>> Hi,
> >>>
> >>> I propose that we clean up the metrics for 0.96 as well (if that is
> not already underway. This includes switching to Hadoop Metrics v2 and
> adding all missing stats, as well as fixing those that are misleading or
> useless. For that reason I talked to our friends at Sematext during the
> Buzzwords HBase workshop, as well as to our internal HBase team. We all
> seem to agree and I'd be happy to setup some sort of call/task force to
> discuss what we need to work on etc. Obviously I would love for someone
> from the FB team to also partake as they have done heaps lately on that end
> - but I also understand if that is a timing issue.
> >>>
> >>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would love for the metrics to be stable by then.
> >>>
> >>
> >> +1 and +1 on you being Ring Master (tell us what to do!)
> >>
> >> Some metrics are near useless.
> >>
> >> Metrics2 is in hadoop 1.0.x? 0.96.0 will require 1.0.x so that should
> be fine.
> >> St.Ack
>
>
-
Re: Metrics in 0.96Stack 2012-06-15, 22:01
On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]> wrote:
> Right now they are very similar to
> RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
> overlap.
>
This would be really great Elliott. You'd package the metrics into
the region server report? protobuf it? Then these would go into
ClusterStatus in master? Good one.
St.Ack
> Right now they are very similar to
> RegionServerMetrics/RegionServerStatistics and seems like there is a lot of
> overlap.
>
This would be really great Elliott. You'd package the metrics into
the region server report? protobuf it? Then these would go into
ClusterStatus in master? Good one.
St.Ack
-
Re: Metrics in 0.96Enis Söztutar 2012-06-15, 23:47
Big +1.
We also need to rename some of the metrics to be consistent in naming, and
make some it more configurable (like enable/disable per-region / per-schema
metrics, etc)
See: https://issues.apache.org/jira/browse/HBASE-5601.
Enis
On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
> wrote:
> > Right now they are very similar to
> > RegionServerMetrics/RegionServerStatistics and seems like there is a lot
> of
> > overlap.
> >
>
> This would be really great Elliott. You'd package the metrics into
> the region server report? protobuf it? Then these would go into
> ClusterStatus in master? Good one.
>
> St.Ack
>
We also need to rename some of the metrics to be consistent in naming, and
make some it more configurable (like enable/disable per-region / per-schema
metrics, etc)
See: https://issues.apache.org/jira/browse/HBASE-5601.
Enis
On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
> wrote:
> > Right now they are very similar to
> > RegionServerMetrics/RegionServerStatistics and seems like there is a lot
> of
> > overlap.
> >
>
> This would be really great Elliott. You'd package the metrics into
> the region server report? protobuf it? Then these would go into
> ClusterStatus in master? Good one.
>
> St.Ack
>
-
Re: Metrics in 0.96Dave Wang 2012-06-16, 00:00
I'm willing to contribute whatever time I can to help out.
- Dave
On Fri, Jun 15, 2012 at 4:47 PM, Enis Söztutar <[EMAIL PROTECTED]> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
> > wrote:
> > > Right now they are very similar to
> > > RegionServerMetrics/RegionServerStatistics and seems like there is a
> lot
> > of
> > > overlap.
> > >
> >
> > This would be really great Elliott. You'd package the metrics into
> > the region server report? protobuf it? Then these would go into
> > ClusterStatus in master? Good one.
> >
> > St.Ack
> >
>
- Dave
On Fri, Jun 15, 2012 at 4:47 PM, Enis Söztutar <[EMAIL PROTECTED]> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>
> > On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
> > wrote:
> > > Right now they are very similar to
> > > RegionServerMetrics/RegionServerStatistics and seems like there is a
> lot
> > of
> > > overlap.
> > >
> >
> > This would be really great Elliott. You'd package the metrics into
> > the region server report? protobuf it? Then these would go into
> > ClusterStatus in master? Good one.
> >
> > St.Ack
> >
>
-
Re: Metrics in 0.96Lars George 2012-06-16, 08:27
Hi Enis,
Hecks yeah, there are so many different prefixes alone that make finding what you need nearly impossible without practice. I agree on the configurable metrics backend, that will allow to enable what is needed optionally. We just have to find a good approach. One of the things that FB has learned the "hard" way is that some metrics at scale are not sustainable. We could, even think about building in some reasonable heuristics to disable some high throughput metrics when a threshold is crossed.
Lars
On Jun 16, 2012, at 1:47, Enis Söztutar <[EMAIL PROTECTED]> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
>> wrote:
>>> Right now they are very similar to
>>> RegionServerMetrics/RegionServerStatistics and seems like there is a lot
>> of
>>> overlap.
>>>
>>
>> This would be really great Elliott. You'd package the metrics into
>> the region server report? protobuf it? Then these would go into
>> ClusterStatus in master? Good one.
>>
>> St.Ack
>>
Hecks yeah, there are so many different prefixes alone that make finding what you need nearly impossible without practice. I agree on the configurable metrics backend, that will allow to enable what is needed optionally. We just have to find a good approach. One of the things that FB has learned the "hard" way is that some metrics at scale are not sustainable. We could, even think about building in some reasonable heuristics to disable some high throughput metrics when a threshold is crossed.
Lars
On Jun 16, 2012, at 1:47, Enis Söztutar <[EMAIL PROTECTED]> wrote:
> Big +1.
>
> We also need to rename some of the metrics to be consistent in naming, and
> make some it more configurable (like enable/disable per-region / per-schema
> metrics, etc)
>
> See: https://issues.apache.org/jira/browse/HBASE-5601.
>
> Enis
>
> On Fri, Jun 15, 2012 at 3:01 PM, Stack <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 15, 2012 at 10:04 AM, Elliott Clark <[EMAIL PROTECTED]>
>> wrote:
>>> Right now they are very similar to
>>> RegionServerMetrics/RegionServerStatistics and seems like there is a lot
>> of
>>> overlap.
>>>
>>
>> This would be really great Elliott. You'd package the metrics into
>> the region server report? protobuf it? Then these would go into
>> ClusterStatus in master? Good one.
>>
>> St.Ack
>>
-
Re: Metrics in 0.96Otis Gospodnetic 2012-06-18, 22:45
Lars & Co.,
We're game for a chat (Skype voice, chat, phone...) maybe around the middle of next week. Alex is currently busy chasing fish in the Caribbean.
Otis
----
Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm
----- Original Message -----
> From: Lars George <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Friday, June 15, 2012 4:07 AM
> Subject: Metrics in 0.96
>
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already
> underway. This includes switching to Hadoop Metrics v2 and adding all missing
> stats, as well as fixing those that are misleading or useless. For that reason I
> talked to our friends at Sematext during the Buzzwords HBase workshop, as well
> as to our internal HBase team. We all seem to agree and I'd be happy to
> setup some sort of call/task force to discuss what we need to work on etc.
> Obviously I would love for someone from the FB team to also partake as they have
> done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would
> love for the metrics to be stable by then.
>
> Cheers,
> Lars
>
We're game for a chat (Skype voice, chat, phone...) maybe around the middle of next week. Alex is currently busy chasing fish in the Caribbean.
Otis
----
Performance Monitoring for Solr / ElasticSearch / HBase - http://sematext.com/spm
----- Original Message -----
> From: Lars George <[EMAIL PROTECTED]>
> To: [EMAIL PROTECTED]
> Cc:
> Sent: Friday, June 15, 2012 4:07 AM
> Subject: Metrics in 0.96
>
> Hi,
>
> I propose that we clean up the metrics for 0.96 as well (if that is not already
> underway. This includes switching to Hadoop Metrics v2 and adding all missing
> stats, as well as fixing those that are misleading or useless. For that reason I
> talked to our friends at Sematext during the Buzzwords HBase workshop, as well
> as to our internal HBase team. We all seem to agree and I'd be happy to
> setup some sort of call/task force to discuss what we need to work on etc.
> Obviously I would love for someone from the FB team to also partake as they have
> done heaps lately on that end - but I also understand if that is a timing issue.
>
> What do y'all think? My reasoning is that 0.96 might become 1.0, but I would
> love for the metrics to be stable by then.
>
> Cheers,
> Lars
>
-
Re: Metrics in 0.96Elliott Clark 2012-06-19, 16:03
I'm up for that too. Just let me know and I'll be there. I've been poking
around with metrics a lot lately and so I have a few ideas.
On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
[EMAIL PROTECTED]> wrote:
> Lars & Co.,
>
> We're game for a chat (Skype voice, chat, phone...) maybe around the
> middle of next week. Alex is currently busy chasing fish in the Caribbean.
>
> Otis
> ----
> Performance Monitoring for Solr / ElasticSearch / HBase -
> http://sematext.com/spm
>
>
>
>
> ----- Original Message -----
> > From: Lars George <[EMAIL PROTECTED]>
> > To: [EMAIL PROTECTED]
> > Cc:
> > Sent: Friday, June 15, 2012 4:07 AM
> > Subject: Metrics in 0.96
> >
> > Hi,
> >
> > I propose that we clean up the metrics for 0.96 as well (if that is not
> already
> > underway. This includes switching to Hadoop Metrics v2 and adding all
> missing
> > stats, as well as fixing those that are misleading or useless. For that
> reason I
> > talked to our friends at Sematext during the Buzzwords HBase workshop,
> as well
> > as to our internal HBase team. We all seem to agree and I'd be happy to
> > setup some sort of call/task force to discuss what we need to work on
> etc.
> > Obviously I would love for someone from the FB team to also partake as
> they have
> > done heaps lately on that end - but I also understand if that is a
> timing issue.
> >
> > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would
> > love for the metrics to be stable by then.
> >
> > Cheers,
> > Lars
> >
>
around with metrics a lot lately and so I have a few ideas.
On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
[EMAIL PROTECTED]> wrote:
> Lars & Co.,
>
> We're game for a chat (Skype voice, chat, phone...) maybe around the
> middle of next week. Alex is currently busy chasing fish in the Caribbean.
>
> Otis
> ----
> Performance Monitoring for Solr / ElasticSearch / HBase -
> http://sematext.com/spm
>
>
>
>
> ----- Original Message -----
> > From: Lars George <[EMAIL PROTECTED]>
> > To: [EMAIL PROTECTED]
> > Cc:
> > Sent: Friday, June 15, 2012 4:07 AM
> > Subject: Metrics in 0.96
> >
> > Hi,
> >
> > I propose that we clean up the metrics for 0.96 as well (if that is not
> already
> > underway. This includes switching to Hadoop Metrics v2 and adding all
> missing
> > stats, as well as fixing those that are misleading or useless. For that
> reason I
> > talked to our friends at Sematext during the Buzzwords HBase workshop,
> as well
> > as to our internal HBase team. We all seem to agree and I'd be happy to
> > setup some sort of call/task force to discuss what we need to work on
> etc.
> > Obviously I would love for someone from the FB team to also partake as
> they have
> > done heaps lately on that end - but I also understand if that is a
> timing issue.
> >
> > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> would
> > love for the metrics to be stable by then.
> >
> > Cheers,
> > Lars
> >
>
-
Re: Metrics in 0.96Gregory Chanan 2012-06-23, 00:23
Do we have an umbrella JIRA for this? Seems like there is a lot of work to
be done on this and it would help to have one similar to HBASE-5305 for the
version compatibility stuff. We can link HBASE-5601 off it to start.
If not, I can create one.
Greg
On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]>wrote:
> I'm up for that too. Just let me know and I'll be there. I've been poking
> around with metrics a lot lately and so I have a few ideas.
>
> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> [EMAIL PROTECTED]> wrote:
>
> > Lars & Co.,
> >
> > We're game for a chat (Skype voice, chat, phone...) maybe around the
> > middle of next week. Alex is currently busy chasing fish in the
> Caribbean.
> >
> > Otis
> > ----
> > Performance Monitoring for Solr / ElasticSearch / HBase -
> > http://sematext.com/spm
> >
> >
> >
> >
> > ----- Original Message -----
> > > From: Lars George <[EMAIL PROTECTED]>
> > > To: [EMAIL PROTECTED]
> > > Cc:
> > > Sent: Friday, June 15, 2012 4:07 AM
> > > Subject: Metrics in 0.96
> > >
> > > Hi,
> > >
> > > I propose that we clean up the metrics for 0.96 as well (if that is not
> > already
> > > underway. This includes switching to Hadoop Metrics v2 and adding all
> > missing
> > > stats, as well as fixing those that are misleading or useless. For that
> > reason I
> > > talked to our friends at Sematext during the Buzzwords HBase workshop,
> > as well
> > > as to our internal HBase team. We all seem to agree and I'd be happy to
> > > setup some sort of call/task force to discuss what we need to work on
> > etc.
> > > Obviously I would love for someone from the FB team to also partake as
> > they have
> > > done heaps lately on that end - but I also understand if that is a
> > timing issue.
> > >
> > > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> > would
> > > love for the metrics to be stable by then.
> > >
> > > Cheers,
> > > Lars
> > >
> >
>
be done on this and it would help to have one similar to HBASE-5305 for the
version compatibility stuff. We can link HBASE-5601 off it to start.
If not, I can create one.
Greg
On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]>wrote:
> I'm up for that too. Just let me know and I'll be there. I've been poking
> around with metrics a lot lately and so I have a few ideas.
>
> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> [EMAIL PROTECTED]> wrote:
>
> > Lars & Co.,
> >
> > We're game for a chat (Skype voice, chat, phone...) maybe around the
> > middle of next week. Alex is currently busy chasing fish in the
> Caribbean.
> >
> > Otis
> > ----
> > Performance Monitoring for Solr / ElasticSearch / HBase -
> > http://sematext.com/spm
> >
> >
> >
> >
> > ----- Original Message -----
> > > From: Lars George <[EMAIL PROTECTED]>
> > > To: [EMAIL PROTECTED]
> > > Cc:
> > > Sent: Friday, June 15, 2012 4:07 AM
> > > Subject: Metrics in 0.96
> > >
> > > Hi,
> > >
> > > I propose that we clean up the metrics for 0.96 as well (if that is not
> > already
> > > underway. This includes switching to Hadoop Metrics v2 and adding all
> > missing
> > > stats, as well as fixing those that are misleading or useless. For that
> > reason I
> > > talked to our friends at Sematext during the Buzzwords HBase workshop,
> > as well
> > > as to our internal HBase team. We all seem to agree and I'd be happy to
> > > setup some sort of call/task force to discuss what we need to work on
> > etc.
> > > Obviously I would love for someone from the FB team to also partake as
> > they have
> > > done heaps lately on that end - but I also understand if that is a
> > timing issue.
> > >
> > > What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> > would
> > > love for the metrics to be stable by then.
> > >
> > > Cheers,
> > > Lars
> > >
> >
>
-
Re: Metrics in 0.96Lars George 2012-06-23, 07:10
Hi Greg,
I am going through all related JIRAs right now so that we can consolidate the effort into one umbrella issue. I should have that done today and will then list my findings.
Lars
On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
> Do we have an umbrella JIRA for this? Seems like there is a lot of work to
> be done on this and it would help to have one similar to HBASE-5305 for the
> version compatibility stuff. We can link HBASE-5601 off it to start.
>
> If not, I can create one.
>
> Greg
> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]>wrote:
>
>> I'm up for that too. Just let me know and I'll be there. I've been poking
>> around with metrics a lot lately and so I have a few ideas.
>>
>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Lars & Co.,
>>>
>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>> middle of next week. Alex is currently busy chasing fish in the
>> Caribbean.
>>>
>>> Otis
>>> ----
>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>> http://sematext.com/spm
>>>
>>>
>>>
>>>
>>> ----- Original Message -----
>>>> From: Lars George <[EMAIL PROTECTED]>
>>>> To: [EMAIL PROTECTED]
>>>> Cc:
>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>> Subject: Metrics in 0.96
>>>>
>>>> Hi,
>>>>
>>>> I propose that we clean up the metrics for 0.96 as well (if that is not
>>> already
>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>> missing
>>>> stats, as well as fixing those that are misleading or useless. For that
>>> reason I
>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>> as well
>>>> as to our internal HBase team. We all seem to agree and I'd be happy to
>>>> setup some sort of call/task force to discuss what we need to work on
>>> etc.
>>>> Obviously I would love for someone from the FB team to also partake as
>>> they have
>>>> done heaps lately on that end - but I also understand if that is a
>>> timing issue.
>>>>
>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>> would
>>>> love for the metrics to be stable by then.
>>>>
>>>> Cheers,
>>>> Lars
>>>>
>>>
>>
I am going through all related JIRAs right now so that we can consolidate the effort into one umbrella issue. I should have that done today and will then list my findings.
Lars
On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
> Do we have an umbrella JIRA for this? Seems like there is a lot of work to
> be done on this and it would help to have one similar to HBASE-5305 for the
> version compatibility stuff. We can link HBASE-5601 off it to start.
>
> If not, I can create one.
>
> Greg
> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]>wrote:
>
>> I'm up for that too. Just let me know and I'll be there. I've been poking
>> around with metrics a lot lately and so I have a few ideas.
>>
>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Lars & Co.,
>>>
>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>> middle of next week. Alex is currently busy chasing fish in the
>> Caribbean.
>>>
>>> Otis
>>> ----
>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>> http://sematext.com/spm
>>>
>>>
>>>
>>>
>>> ----- Original Message -----
>>>> From: Lars George <[EMAIL PROTECTED]>
>>>> To: [EMAIL PROTECTED]
>>>> Cc:
>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>> Subject: Metrics in 0.96
>>>>
>>>> Hi,
>>>>
>>>> I propose that we clean up the metrics for 0.96 as well (if that is not
>>> already
>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>> missing
>>>> stats, as well as fixing those that are misleading or useless. For that
>>> reason I
>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>> as well
>>>> as to our internal HBase team. We all seem to agree and I'd be happy to
>>>> setup some sort of call/task force to discuss what we need to work on
>>> etc.
>>>> Obviously I would love for someone from the FB team to also partake as
>>> they have
>>>> done heaps lately on that end - but I also understand if that is a
>>> timing issue.
>>>>
>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>> would
>>>> love for the metrics to be stable by then.
>>>>
>>>> Cheers,
>>>> Lars
>>>>
>>>
>>
-
Re: Metrics in 0.96Alex Baranau 2012-06-29, 16:06
Hi Lars,
Any chance you created umbrella jira for that?
Thank you,
Alex
On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Greg,
>
> I am going through all related JIRAs right now so that we can consolidate
> the effort into one umbrella issue. I should have that done today and will
> then list my findings.
>
> Lars
>
> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
>
> > Do we have an umbrella JIRA for this? Seems like there is a lot of work
> to
> > be done on this and it would help to have one similar to HBASE-5305 for
> the
> > version compatibility stuff. We can link HBASE-5601 off it to start.
> >
> > If not, I can create one.
> >
> > Greg
> > On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
> >wrote:
> >
> >> I'm up for that too. Just let me know and I'll be there. I've been
> poking
> >> around with metrics a lot lately and so I have a few ideas.
> >>
> >> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Lars & Co.,
> >>>
> >>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>> middle of next week. Alex is currently busy chasing fish in the
> >> Caribbean.
> >>>
> >>> Otis
> >>> ----
> >>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>> http://sematext.com/spm
> >>>
> >>>
> >>>
> >>>
> >>> ----- Original Message -----
> >>>> From: Lars George <[EMAIL PROTECTED]>
> >>>> To: [EMAIL PROTECTED]
> >>>> Cc:
> >>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>> Subject: Metrics in 0.96
> >>>>
> >>>> Hi,
> >>>>
> >>>> I propose that we clean up the metrics for 0.96 as well (if that is
> not
> >>> already
> >>>> underway. This includes switching to Hadoop Metrics v2 and adding all
> >>> missing
> >>>> stats, as well as fixing those that are misleading or useless. For
> that
> >>> reason I
> >>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
> >>> as well
> >>>> as to our internal HBase team. We all seem to agree and I'd be happy
> to
> >>>> setup some sort of call/task force to discuss what we need to work on
> >>> etc.
> >>>> Obviously I would love for someone from the FB team to also partake as
> >>> they have
> >>>> done heaps lately on that end - but I also understand if that is a
> >>> timing issue.
> >>>>
> >>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> >>> would
> >>>> love for the metrics to be stable by then.
> >>>>
> >>>> Cheers,
> >>>> Lars
> >>>>
> >>>
> >>
>
Any chance you created umbrella jira for that?
Thank you,
Alex
On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Greg,
>
> I am going through all related JIRAs right now so that we can consolidate
> the effort into one umbrella issue. I should have that done today and will
> then list my findings.
>
> Lars
>
> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
>
> > Do we have an umbrella JIRA for this? Seems like there is a lot of work
> to
> > be done on this and it would help to have one similar to HBASE-5305 for
> the
> > version compatibility stuff. We can link HBASE-5601 off it to start.
> >
> > If not, I can create one.
> >
> > Greg
> > On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
> >wrote:
> >
> >> I'm up for that too. Just let me know and I'll be there. I've been
> poking
> >> around with metrics a lot lately and so I have a few ideas.
> >>
> >> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Lars & Co.,
> >>>
> >>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>> middle of next week. Alex is currently busy chasing fish in the
> >> Caribbean.
> >>>
> >>> Otis
> >>> ----
> >>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>> http://sematext.com/spm
> >>>
> >>>
> >>>
> >>>
> >>> ----- Original Message -----
> >>>> From: Lars George <[EMAIL PROTECTED]>
> >>>> To: [EMAIL PROTECTED]
> >>>> Cc:
> >>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>> Subject: Metrics in 0.96
> >>>>
> >>>> Hi,
> >>>>
> >>>> I propose that we clean up the metrics for 0.96 as well (if that is
> not
> >>> already
> >>>> underway. This includes switching to Hadoop Metrics v2 and adding all
> >>> missing
> >>>> stats, as well as fixing those that are misleading or useless. For
> that
> >>> reason I
> >>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
> >>> as well
> >>>> as to our internal HBase team. We all seem to agree and I'd be happy
> to
> >>>> setup some sort of call/task force to discuss what we need to work on
> >>> etc.
> >>>> Obviously I would love for someone from the FB team to also partake as
> >>> they have
> >>>> done heaps lately on that end - but I also understand if that is a
> >>> timing issue.
> >>>>
> >>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
> >>> would
> >>>> love for the metrics to be stable by then.
> >>>>
> >>>> Cheers,
> >>>> Lars
> >>>>
> >>>
> >>
>
-
Re: Metrics in 0.96Lars George 2012-06-29, 17:21
Hi Alex,
Not yet, I fell short in my effort of ready all of the open and recently completed metrics related JIRAs. But I will finish it over the weekend and create the issue, if that is OK?
Lars
On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
> Hi Lars,
>
> Any chance you created umbrella jira for that?
>
> Thank you,
> Alex
>
> On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]> wrote:
>
>> Hi Greg,
>>
>> I am going through all related JIRAs right now so that we can consolidate
>> the effort into one umbrella issue. I should have that done today and will
>> then list my findings.
>>
>> Lars
>>
>> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
>>
>>> Do we have an umbrella JIRA for this? Seems like there is a lot of work
>> to
>>> be done on this and it would help to have one similar to HBASE-5305 for
>> the
>>> version compatibility stuff. We can link HBASE-5601 off it to start.
>>>
>>> If not, I can create one.
>>>
>>> Greg
>>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
>>> wrote:
>>>
>>>> I'm up for that too. Just let me know and I'll be there. I've been
>> poking
>>>> around with metrics a lot lately and so I have a few ideas.
>>>>
>>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> Lars & Co.,
>>>>>
>>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>>>> middle of next week. Alex is currently busy chasing fish in the
>>>> Caribbean.
>>>>>
>>>>> Otis
>>>>> ----
>>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>>>> http://sematext.com/spm
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ----- Original Message -----
>>>>>> From: Lars George <[EMAIL PROTECTED]>
>>>>>> To: [EMAIL PROTECTED]
>>>>>> Cc:
>>>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>>>> Subject: Metrics in 0.96
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
>> not
>>>>> already
>>>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>>>> missing
>>>>>> stats, as well as fixing those that are misleading or useless. For
>> that
>>>>> reason I
>>>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>>>> as well
>>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
>> to
>>>>>> setup some sort of call/task force to discuss what we need to work on
>>>>> etc.
>>>>>> Obviously I would love for someone from the FB team to also partake as
>>>>> they have
>>>>>> done heaps lately on that end - but I also understand if that is a
>>>>> timing issue.
>>>>>>
>>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>>>> would
>>>>>> love for the metrics to be stable by then.
>>>>>>
>>>>>> Cheers,
>>>>>> Lars
>>>>>>
>>>>>
>>>>
>>
Not yet, I fell short in my effort of ready all of the open and recently completed metrics related JIRAs. But I will finish it over the weekend and create the issue, if that is OK?
Lars
On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
> Hi Lars,
>
> Any chance you created umbrella jira for that?
>
> Thank you,
> Alex
>
> On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]> wrote:
>
>> Hi Greg,
>>
>> I am going through all related JIRAs right now so that we can consolidate
>> the effort into one umbrella issue. I should have that done today and will
>> then list my findings.
>>
>> Lars
>>
>> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
>>
>>> Do we have an umbrella JIRA for this? Seems like there is a lot of work
>> to
>>> be done on this and it would help to have one similar to HBASE-5305 for
>> the
>>> version compatibility stuff. We can link HBASE-5601 off it to start.
>>>
>>> If not, I can create one.
>>>
>>> Greg
>>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
>>> wrote:
>>>
>>>> I'm up for that too. Just let me know and I'll be there. I've been
>> poking
>>>> around with metrics a lot lately and so I have a few ideas.
>>>>
>>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
>>>> [EMAIL PROTECTED]> wrote:
>>>>
>>>>> Lars & Co.,
>>>>>
>>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
>>>>> middle of next week. Alex is currently busy chasing fish in the
>>>> Caribbean.
>>>>>
>>>>> Otis
>>>>> ----
>>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
>>>>> http://sematext.com/spm
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> ----- Original Message -----
>>>>>> From: Lars George <[EMAIL PROTECTED]>
>>>>>> To: [EMAIL PROTECTED]
>>>>>> Cc:
>>>>>> Sent: Friday, June 15, 2012 4:07 AM
>>>>>> Subject: Metrics in 0.96
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
>> not
>>>>> already
>>>>>> underway. This includes switching to Hadoop Metrics v2 and adding all
>>>>> missing
>>>>>> stats, as well as fixing those that are misleading or useless. For
>> that
>>>>> reason I
>>>>>> talked to our friends at Sematext during the Buzzwords HBase workshop,
>>>>> as well
>>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
>> to
>>>>>> setup some sort of call/task force to discuss what we need to work on
>>>>> etc.
>>>>>> Obviously I would love for someone from the FB team to also partake as
>>>>> they have
>>>>>> done heaps lately on that end - but I also understand if that is a
>>>>> timing issue.
>>>>>>
>>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0, but I
>>>>> would
>>>>>> love for the metrics to be stable by then.
>>>>>>
>>>>>> Cheers,
>>>>>> Lars
>>>>>>
>>>>>
>>>>
>>
-
Re: Metrics in 0.96Alex Baranau 2012-06-29, 20:10
Meanwhile I suggested taking on this one:
https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
you think?
Alex
On Fri, Jun 29, 2012 at 1:21 PM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Alex,
>
> Not yet, I fell short in my effort of ready all of the open and recently
> completed metrics related JIRAs. But I will finish it over the weekend and
> create the issue, if that is OK?
>
> Lars
>
> On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
>
> > Hi Lars,
> >
> > Any chance you created umbrella jira for that?
> >
> > Thank you,
> > Alex
> >
> > On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]>
> wrote:
> >
> >> Hi Greg,
> >>
> >> I am going through all related JIRAs right now so that we can
> consolidate
> >> the effort into one umbrella issue. I should have that done today and
> will
> >> then list my findings.
> >>
> >> Lars
> >>
> >> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
> >>
> >>> Do we have an umbrella JIRA for this? Seems like there is a lot of
> work
> >> to
> >>> be done on this and it would help to have one similar to HBASE-5305 for
> >> the
> >>> version compatibility stuff. We can link HBASE-5601 off it to start.
> >>>
> >>> If not, I can create one.
> >>>
> >>> Greg
> >>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
> >>> wrote:
> >>>
> >>>> I'm up for that too. Just let me know and I'll be there. I've been
> >> poking
> >>>> around with metrics a lot lately and so I have a few ideas.
> >>>>
> >>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >>>> [EMAIL PROTECTED]> wrote:
> >>>>
> >>>>> Lars & Co.,
> >>>>>
> >>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>>>> middle of next week. Alex is currently busy chasing fish in the
> >>>> Caribbean.
> >>>>>
> >>>>> Otis
> >>>>> ----
> >>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>>>> http://sematext.com/spm
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ----- Original Message -----
> >>>>>> From: Lars George <[EMAIL PROTECTED]>
> >>>>>> To: [EMAIL PROTECTED]
> >>>>>> Cc:
> >>>>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>>>> Subject: Metrics in 0.96
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
> >> not
> >>>>> already
> >>>>>> underway. This includes switching to Hadoop Metrics v2 and adding
> all
> >>>>> missing
> >>>>>> stats, as well as fixing those that are misleading or useless. For
> >> that
> >>>>> reason I
> >>>>>> talked to our friends at Sematext during the Buzzwords HBase
> workshop,
> >>>>> as well
> >>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
> >> to
> >>>>>> setup some sort of call/task force to discuss what we need to work
> on
> >>>>> etc.
> >>>>>> Obviously I would love for someone from the FB team to also partake
> as
> >>>>> they have
> >>>>>> done heaps lately on that end - but I also understand if that is a
> >>>>> timing issue.
> >>>>>>
> >>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0,
> but I
> >>>>> would
> >>>>>> love for the metrics to be stable by then.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Lars
> >>>>>>
> >>>>>
> >>>>
> >>
>
>
https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
you think?
Alex
On Fri, Jun 29, 2012 at 1:21 PM, Lars George <[EMAIL PROTECTED]> wrote:
> Hi Alex,
>
> Not yet, I fell short in my effort of ready all of the open and recently
> completed metrics related JIRAs. But I will finish it over the weekend and
> create the issue, if that is OK?
>
> Lars
>
> On Jun 29, 2012, at 7:06 PM, Alex Baranau wrote:
>
> > Hi Lars,
> >
> > Any chance you created umbrella jira for that?
> >
> > Thank you,
> > Alex
> >
> > On Sat, Jun 23, 2012 at 3:10 AM, Lars George <[EMAIL PROTECTED]>
> wrote:
> >
> >> Hi Greg,
> >>
> >> I am going through all related JIRAs right now so that we can
> consolidate
> >> the effort into one umbrella issue. I should have that done today and
> will
> >> then list my findings.
> >>
> >> Lars
> >>
> >> On Jun 23, 2012, at 2:23, Gregory Chanan <[EMAIL PROTECTED]> wrote:
> >>
> >>> Do we have an umbrella JIRA for this? Seems like there is a lot of
> work
> >> to
> >>> be done on this and it would help to have one similar to HBASE-5305 for
> >> the
> >>> version compatibility stuff. We can link HBASE-5601 off it to start.
> >>>
> >>> If not, I can create one.
> >>>
> >>> Greg
> >>> On Tue, Jun 19, 2012 at 9:03 AM, Elliott Clark <[EMAIL PROTECTED]
> >>> wrote:
> >>>
> >>>> I'm up for that too. Just let me know and I'll be there. I've been
> >> poking
> >>>> around with metrics a lot lately and so I have a few ideas.
> >>>>
> >>>> On Mon, Jun 18, 2012 at 3:45 PM, Otis Gospodnetic <
> >>>> [EMAIL PROTECTED]> wrote:
> >>>>
> >>>>> Lars & Co.,
> >>>>>
> >>>>> We're game for a chat (Skype voice, chat, phone...) maybe around the
> >>>>> middle of next week. Alex is currently busy chasing fish in the
> >>>> Caribbean.
> >>>>>
> >>>>> Otis
> >>>>> ----
> >>>>> Performance Monitoring for Solr / ElasticSearch / HBase -
> >>>>> http://sematext.com/spm
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> ----- Original Message -----
> >>>>>> From: Lars George <[EMAIL PROTECTED]>
> >>>>>> To: [EMAIL PROTECTED]
> >>>>>> Cc:
> >>>>>> Sent: Friday, June 15, 2012 4:07 AM
> >>>>>> Subject: Metrics in 0.96
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> I propose that we clean up the metrics for 0.96 as well (if that is
> >> not
> >>>>> already
> >>>>>> underway. This includes switching to Hadoop Metrics v2 and adding
> all
> >>>>> missing
> >>>>>> stats, as well as fixing those that are misleading or useless. For
> >> that
> >>>>> reason I
> >>>>>> talked to our friends at Sematext during the Buzzwords HBase
> workshop,
> >>>>> as well
> >>>>>> as to our internal HBase team. We all seem to agree and I'd be happy
> >> to
> >>>>>> setup some sort of call/task force to discuss what we need to work
> on
> >>>>> etc.
> >>>>>> Obviously I would love for someone from the FB team to also partake
> as
> >>>>> they have
> >>>>>> done heaps lately on that end - but I also understand if that is a
> >>>>> timing issue.
> >>>>>>
> >>>>>> What do y'all think? My reasoning is that 0.96 might become 1.0,
> but I
> >>>>> would
> >>>>>> love for the metrics to be stable by then.
> >>>>>>
> >>>>>> Cheers,
> >>>>>> Lars
> >>>>>>
> >>>>>
> >>>>
> >>
>
>
-
Re: Metrics in 0.96Andrew Purtell 2012-06-29, 20:15
On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]> wrote:
> Meanwhile I suggested taking on this one:
> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
> you think?
+1
In related discussion, it looks to me like Stack thinks pulling in the
histogram accuracy improvement work via metrics2 is a good idea.
Independent of this something I would like to be able to do is log
metrics to a file as well as Ganglia concurrently, and metrics2 can do
that.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
> Meanwhile I suggested taking on this one:
> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What do
> you think?
+1
In related discussion, it looks to me like Stack thinks pulling in the
histogram accuracy improvement work via metrics2 is a good idea.
Independent of this something I would like to be able to do is log
metrics to a file as well as Ganglia concurrently, and metrics2 can do
that.
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
-
Re: Metrics in 0.96Elliott Clark 2012-06-29, 20:53
I'm excited about the new accurate histogram, however I don't think that
we'll get it when we move to metrics2. Any direct usage would break
backward compat for all older hadoop installs.
For backwards compatibility on hadoop versions we will either have to
create a shim layer with reflection, or pull the code in. Since we already
have a MeticsHistogram I think pulling the code into hbase may be the right
choice.
On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
> wrote:
> > Meanwhile I suggested taking on this one:
> > https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
> do
> > you think?
>
> +1
>
> In related discussion, it looks to me like Stack thinks pulling in the
> histogram accuracy improvement work via metrics2 is a good idea.
>
> Independent of this something I would like to be able to do is log
> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> that.
>
>
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein (via Tom White)
>
we'll get it when we move to metrics2. Any direct usage would break
backward compat for all older hadoop installs.
For backwards compatibility on hadoop versions we will either have to
create a shim layer with reflection, or pull the code in. Since we already
have a MeticsHistogram I think pulling the code into hbase may be the right
choice.
On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
> wrote:
> > Meanwhile I suggested taking on this one:
> > https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
> do
> > you think?
>
> +1
>
> In related discussion, it looks to me like Stack thinks pulling in the
> histogram accuracy improvement work via metrics2 is a good idea.
>
> Independent of this something I would like to be able to do is log
> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> that.
>
>
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein (via Tom White)
>
-
Re: Metrics in 0.96Ted Yu 2012-06-29, 21:45
I suggest continuing discussion on HBASE-4050.
Cheers
On Fri, Jun 29, 2012 at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]>wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
>
> > On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
> > wrote:
> > > Meanwhile I suggested taking on this one:
> > > https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> > do
> > > you think?
> >
> > +1
> >
> > In related discussion, it looks to me like Stack thinks pulling in the
> > histogram accuracy improvement work via metrics2 is a good idea.
> >
> > Independent of this something I would like to be able to do is log
> > metrics to a file as well as Ganglia concurrently, and metrics2 can do
> > that.
> >
> >
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein (via Tom White)
> >
>
Cheers
On Fri, Jun 29, 2012 at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]>wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
>
> > On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
> > wrote:
> > > Meanwhile I suggested taking on this one:
> > > https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> > do
> > > you think?
> >
> > +1
> >
> > In related discussion, it looks to me like Stack thinks pulling in the
> > histogram accuracy improvement work via metrics2 is a good idea.
> >
> > Independent of this something I would like to be able to do is log
> > metrics to a file as well as Ganglia concurrently, and metrics2 can do
> > that.
> >
> >
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein (via Tom White)
> >
>
-
Re: Metrics in 0.96Andrew Purtell 2012-06-30, 00:31
Metrics2 is in both Hadoop 1 and 2. (?)
But my thing was the latter point below anyhow.
On Jun 29, 2012, at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]> wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
>> wrote:
>>> Meanwhile I suggested taking on this one:
>>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
>> do
>>> you think?
>>
>> +1
>>
>> In related discussion, it looks to me like Stack thinks pulling in the
>> histogram accuracy improvement work via metrics2 is a good idea.
>>
>> Independent of this something I would like to be able to do is log
>> metrics to a file as well as Ganglia concurrently, and metrics2 can do
>> that.
>>
>>
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein (via Tom White)
>>
But my thing was the latter point below anyhow.
On Jun 29, 2012, at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]> wrote:
> I'm excited about the new accurate histogram, however I don't think that
> we'll get it when we move to metrics2. Any direct usage would break
> backward compat for all older hadoop installs.
> For backwards compatibility on hadoop versions we will either have to
> create a shim layer with reflection, or pull the code in. Since we already
> have a MeticsHistogram I think pulling the code into hbase may be the right
> choice.
>
> On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]> wrote:
>
>> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]>
>> wrote:
>>> Meanwhile I suggested taking on this one:
>>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first. What
>> do
>>> you think?
>>
>> +1
>>
>> In related discussion, it looks to me like Stack thinks pulling in the
>> histogram accuracy improvement work via metrics2 is a good idea.
>>
>> Independent of this something I would like to be able to do is log
>> metrics to a file as well as Ganglia concurrently, and metrics2 can do
>> that.
>>
>>
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein (via Tom White)
>>
-
Re: Metrics in 0.96Andrew Wang 2012-06-30, 00:41
I think Elliot's concern with the histogram improvements is that if it goes
in hadoop-common, HBase is only going to get it after it gets rolled into a
new hadoop-common release and HBase bumps the version on the hadoop-common
dependency. I don't think this is so bad.
For now though, I'm willing to maintain an HBase patchset against this
future improved hadoop-common until it's actually released.
Thanks,
Andrew
On Fri, Jun 29, 2012 at 5:31 PM, Andrew Purtell <[EMAIL PROTECTED]>wrote:
> Metrics2 is in both Hadoop 1 and 2. (?)
>
> But my thing was the latter point below anyhow.
>
> On Jun 29, 2012, at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]> wrote:
>
> > I'm excited about the new accurate histogram, however I don't think that
> > we'll get it when we move to metrics2. Any direct usage would break
> > backward compat for all older hadoop installs.
> > For backwards compatibility on hadoop versions we will either have to
> > create a shim layer with reflection, or pull the code in. Since we
> already
> > have a MeticsHistogram I think pulling the code into hbase may be the
> right
> > choice.
> >
> > On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
> >
> >> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]
> >
> >> wrote:
> >>> Meanwhile I suggested taking on this one:
> >>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> >> do
> >>> you think?
> >>
> >> +1
> >>
> >> In related discussion, it looks to me like Stack thinks pulling in the
> >> histogram accuracy improvement work via metrics2 is a good idea.
> >>
> >> Independent of this something I would like to be able to do is log
> >> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> >> that.
> >>
> >>
> >> Best regards,
> >>
> >> - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein (via Tom White)
> >>
>
in hadoop-common, HBase is only going to get it after it gets rolled into a
new hadoop-common release and HBase bumps the version on the hadoop-common
dependency. I don't think this is so bad.
For now though, I'm willing to maintain an HBase patchset against this
future improved hadoop-common until it's actually released.
Thanks,
Andrew
On Fri, Jun 29, 2012 at 5:31 PM, Andrew Purtell <[EMAIL PROTECTED]>wrote:
> Metrics2 is in both Hadoop 1 and 2. (?)
>
> But my thing was the latter point below anyhow.
>
> On Jun 29, 2012, at 1:53 PM, Elliott Clark <[EMAIL PROTECTED]> wrote:
>
> > I'm excited about the new accurate histogram, however I don't think that
> > we'll get it when we move to metrics2. Any direct usage would break
> > backward compat for all older hadoop installs.
> > For backwards compatibility on hadoop versions we will either have to
> > create a shim layer with reflection, or pull the code in. Since we
> already
> > have a MeticsHistogram I think pulling the code into hbase may be the
> right
> > choice.
> >
> > On Fri, Jun 29, 2012 at 1:15 PM, Andrew Purtell <[EMAIL PROTECTED]>
> wrote:
> >
> >> On Fri, Jun 29, 2012 at 1:10 PM, Alex Baranau <[EMAIL PROTECTED]
> >
> >> wrote:
> >>> Meanwhile I suggested taking on this one:
> >>> https://issues.apache.org/jira/browse/HBASE-4050 separately/first.
> What
> >> do
> >>> you think?
> >>
> >> +1
> >>
> >> In related discussion, it looks to me like Stack thinks pulling in the
> >> histogram accuracy improvement work via metrics2 is a good idea.
> >>
> >> Independent of this something I would like to be able to do is log
> >> metrics to a file as well as Ganglia concurrently, and metrics2 can do
> >> that.
> >>
> >>
> >> Best regards,
> >>
> >> - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein (via Tom White)
> >>
>
