HDFS, mail # dev - Re: how can we know the statistics of namenode and datanode using API's

how can we know the statistics of namenode and datanode using API's

Vidur Goyal 2010-06-11, 05:39

Hi All,

I have been trying to access the statistics of FSNameSystem using
FSNameSystemMetrics , but i have not been able to do it yet. Am I doing it
right, if not kindly guide me. I am stuck.

Thanks,
Vidur

--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.

Re: how can we know the statistics of namenode and datanode using API's

Brian Bockelman 2010-06-11, 12:45

Hey Vidur,

Do you need to access it directly in Java, or can you just parse them out of (for example) Ganglia? There are JMX statistics, but I am not familiar enough with JMX at the code level to give you decent advise.

Brian

On Jun 11, 2010, at 12:39 AM, Vidur Goyal wrote:

> Hi All,
>
> I have been trying to access the statistics of FSNameSystem using
> FSNameSystemMetrics , but i have not been able to do it yet. Am I doing it
> right, if not kindly guide me. I am stuck.
>
> Thanks,
> Vidur
>
> --
> This message has been scanned for viruses and
> dangerous content by MailScanner, and is
> believed to be clean.

Re: how can we know the statistics of namenode and datanode using API's

Vidur Goyal 2010-06-11, 13:51

Hello Brian,

I am trying to use Hadoop API's to know the status. If you see the log
files , you will find various parameters of the system listed at the time
of start of Namenode.

I want to know how to use org.apache.hadoop.hdfs.server.namenode.metrics ,
to get the system statistics.

Thanks,
Vidur

> Hey Vidur,
>
> Do you need to access it directly in Java, or can you just parse them out
> of (for example) Ganglia? There are JMX statistics, but I am not familiar
> enough with JMX at the code level to give you decent advise.
>
> Brian
>
> On Jun 11, 2010, at 12:39 AM, Vidur Goyal wrote:
>
>> Hi All,
>>
>> I have been trying to access the statistics of FSNameSystem using
>> FSNameSystemMetrics , but i have not been able to do it yet. Am I doing
>> it
>> right, if not kindly guide me. I am stuck.
>>
>> Thanks,
>> Vidur
>>
>> --
>> This message has been scanned for viruses and
>> dangerous content by MailScanner, and is
>> believed to be clean.
>
>
> --
> This message has been scanned for viruses and
> dangerous content by MailScanner, and is
> believed to be clean.
>
>
--
This message has been scanned for viruses and
dangerous content by MailScanner, and is
believed to be clean.