Hi guys :I wanted to go through each of the server logs on my hadoop
(single psuedo node) vm.

In particular, I want to know where to look when things go wrong (i.e. so I
can more effectively debug hadoop namenode issues in the future).

Can someone suggest what the most important ones to start looking at are ?

--
Jay Vyas
MMSB/UCHC

If you want to trace one particular block associated with a file, you can first check the file Name and find the NameSystem.allocateBlock: from your NN logs.
 here you can find the allocated blockID. After this, you just grep with this blockID from your huge logs. Take the time spamps for each operations based on this grep information. easily you can trace what happend to that block.

Regards,
Uma
----- Original Message -----
From: Jay Vyas <[EMAIL PROTECTED]>
Date: Tuesday, November 1, 2011 3:37 am
Subject: Server log files, order of importance ?
To: [EMAIL PROTECTED]

> Hi guys :I wanted to go through each of the server logs on my hadoop
> (single psuedo node) vm.
>
> In particular, I want to know where to look when things go wrong
> (i.e. so I
> can more effectively debug hadoop namenode issues in the future).
>
> Can someone suggest what the most important ones to start looking
> at are ?
>
> --
> Jay Vyas
> MMSB/UCHC
>

Thanks uma : I was looking for a more general list.  Is there a good
summary of various hadoop daemons and their logs online ?

On Mon, Oct 31, 2011 at 6:16 PM, Uma Maheswara Rao G 72686 <
[EMAIL PROTECTED]> wrote:

> If you want to trace one particular block associated with a file, you can
> first check the file Name and find the NameSystem.allocateBlock: from your
> NN logs.
>  here you can find the allocated blockID. After this, you just grep with
> this blockID from your huge logs. Take the time spamps for each operations
> based on this grep information. easily you can trace what happend to that
> block.
>
> Regards,
> Uma
> ----- Original Message -----
> From: Jay Vyas <[EMAIL PROTECTED]>
> Date: Tuesday, November 1, 2011 3:37 am
> Subject: Server log files, order of importance ?
> To: [EMAIL PROTECTED]
>
> > Hi guys :I wanted to go through each of the server logs on my hadoop
> > (single psuedo node) vm.
> >
> > In particular, I want to know where to look when things go wrong
> > (i.e. so I
> > can more effectively debug hadoop namenode issues in the future).
> >
> > Can someone suggest what the most important ones to start looking
> > at are ?
> >
> > --
> > Jay Vyas
> > MMSB/UCHC
> >
>

--
Jay Vyas
MMSB/UCHC