Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> metrics2 ganglia monitoring


Copy link to this message
-
Re: metrics2 ganglia monitoring
Ganglia plugin is not yet ported to metrics v2 (because Y don't use
Ganglia, see also the discussion links on HADOOP-6728). It shouldn't
be hard to do a port though, as the new sink interface is actually
simpler.

On Wed, May 18, 2011 at 4:07 AM, Eric Berkowitz
<[EMAIL PROTECTED]> wrote:
> We have a 2 rack hadoop cluster with ganglia 3.0 monitoring on all stations both on the native os and within hadoop.
>
> We want to upgrade to the to hadoop 20.203 but with the migration to metrics2 we need help configuring the metrics to continue ganglia monitoring.
>
> All tasktrackers/datanodes push unicast udp upstream to a central gmond daemon on their rack that is then polled by a single gmetad daemon for the cluster.
>
> The current metrics files includes entries similar to the following for all contexts:
>
> Configuration of the "dfs" context for ganglia
> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> dfs.period=25
> dfs.servers=xsrv1.cs.roosevelt.edu:8670
>
> We have reviewed the package documentation for metrics2 but the examples and explanation are not helpful.  Any assistance in the proper configuration of
> hadoop-metrics2.properties file to support our current ganglia configuration would be appreciated.
>
> Eric
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB