Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop >> mail # user >> metrics2 ganglia monitoring


Copy link to this message
-
Re: metrics2 ganglia monitoring
Ganglia plugin is not yet ported to metrics v2 (because Y don't use
Ganglia, see also the discussion links on HADOOP-6728). It shouldn't
be hard to do a port though, as the new sink interface is actually
simpler.

On Wed, May 18, 2011 at 4:07 AM, Eric Berkowitz
<[EMAIL PROTECTED]> wrote:
> We have a 2 rack hadoop cluster with ganglia 3.0 monitoring on all stations both on the native os and within hadoop.
>
> We want to upgrade to the to hadoop 20.203 but with the migration to metrics2 we need help configuring the metrics to continue ganglia monitoring.
>
> All tasktrackers/datanodes push unicast udp upstream to a central gmond daemon on their rack that is then polled by a single gmetad daemon for the cluster.
>
> The current metrics files includes entries similar to the following for all contexts:
>
> Configuration of the "dfs" context for ganglia
> dfs.class=org.apache.hadoop.metrics.ganglia.GangliaContext
> dfs.period=25
> dfs.servers=xsrv1.cs.roosevelt.edu:8670
>
> We have reviewed the package documentation for metrics2 but the examples and explanation are not helpful.  Any assistance in the proper configuration of
> hadoop-metrics2.properties file to support our current ganglia configuration would be appreciated.
>
> Eric