Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Problem formatting namenode


Copy link to this message
-
Re: Problem formatting namenode
Konstantin Boudnik 2010-03-18, 17:41
These are 2004 dated issues. JDK team at Sun is better than not touching bugs
for almost 6 years, c'mon.

    Cos

On Thu, Mar 18, 2010 at 12:15AM, Gokulakannan M wrote:
>    Hi Todd,
>
>    
>
>                What I meant is that sun nio has issues when it comes to large
>    volume of data.
>
>              
>
>                These are the references related to this.
>
>                http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4938442
>                http://forums.sun.com/thread.jspa?threadID=607775
>
>    
>
>                Coming back to this issue, I suspected that nio might be
>    having similar problem when it comes to large disk volume also.
>
>    
>
>     Thanks,
>
>      Gokul
>
>    
>
>    --------------------------------------------------------------------------
>
>    From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
>    Sent: Wednesday, March 17, 2010 9:26 PM
>    To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
>    Subject: Re: Problem formatting namenode
>
>    
>
>    Hi Gokul,
>
>    Do you have a reference to a Java bug ID that discusses this? I wasn't
>    aware of problems with large disks and Java NIO.
>
>    -Todd
>
>    On Tue, Mar 16, 2010 at 11:49 PM, Gokulakannan M <[EMAIL PROTECTED]>
>    wrote:
>
>    Hi,
>
>    
>
>          The problem here is the FileDispatcher.pwrite of sun nio.
>
>          The FileDispatcher.java has so many issues when it comes to large
>    volume.    
>
>    
>
>          Can anyone suggest an alternative that can be used instead of sun
>
>          nio's FileDispatcher.java in
>
>    
>
>        
>    org.apache.hadoop.hdfs.server.namenode.FSEditLog$EditLogFileOutputStream.pre
>    allocate(FSEditLog.java:228) ???
>
>    
>
>    
>
>     Thanks,
>
>      Gokul
>
>    
>
>    
>
>    
>
>    --
>    Todd Lipcon
>    Software Engineer, Cloudera