Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> Problem formatting namenode


Copy link to this message
-
Re: Problem formatting namenode
These are 2004 dated issues. JDK team at Sun is better than not touching bugs
for almost 6 years, c'mon.

    Cos

On Thu, Mar 18, 2010 at 12:15AM, Gokulakannan M wrote:
>    Hi Todd,
>
>    
>
>                What I meant is that sun nio has issues when it comes to large
>    volume of data.
>
>              
>
>                These are the references related to this.
>
>                http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=4938442
>                http://forums.sun.com/thread.jspa?threadID=607775
>
>    
>
>                Coming back to this issue, I suspected that nio might be
>    having similar problem when it comes to large disk volume also.
>
>    
>
>     Thanks,
>
>      Gokul
>
>    
>
>    --------------------------------------------------------------------------
>
>    From: Todd Lipcon [mailto:[EMAIL PROTECTED]]
>    Sent: Wednesday, March 17, 2010 9:26 PM
>    To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
>    Subject: Re: Problem formatting namenode
>
>    
>
>    Hi Gokul,
>
>    Do you have a reference to a Java bug ID that discusses this? I wasn't
>    aware of problems with large disks and Java NIO.
>
>    -Todd
>
>    On Tue, Mar 16, 2010 at 11:49 PM, Gokulakannan M <[EMAIL PROTECTED]>
>    wrote:
>
>    Hi,
>
>    
>
>          The problem here is the FileDispatcher.pwrite of sun nio.
>
>          The FileDispatcher.java has so many issues when it comes to large
>    volume.    
>
>    
>
>          Can anyone suggest an alternative that can be used instead of sun
>
>          nio's FileDispatcher.java in
>
>    
>
>        
>    org.apache.hadoop.hdfs.server.namenode.FSEditLog$EditLogFileOutputStream.pre
>    allocate(FSEditLog.java:228) ???
>
>    
>
>    
>
>     Thanks,
>
>      Gokul
>
>    
>
>    
>
>    
>
>    --
>    Todd Lipcon
>    Software Engineer, Cloudera
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB