Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Setting up a second cluster and getting a weird issue


Copy link to this message
-
Re: Setting up a second cluster and getting a weird issue
Jeff Zhang 2010-05-14, 01:51
It is not suggested to deploy hadoop on NFS, there will be conflict
between data nodes, because NFS share the same namespace of file
system.

On Thu, May 13, 2010 at 9:52 PM, Andrew Nguyen <[EMAIL PROTECTED]> wrote:
>
> Yes, in this deployment, I'm attempting to share the hadoop files via NFS.  The log and pid directories are local.
>
> Thanks!
>
> --Andrew
>
> On May 12, 2010, at 7:40 PM, Jeff Zhang wrote:
>
> > These 4 nodes share NFS ?
> >
> >
> > On Thu, May 13, 2010 at 8:19 AM, Andrew Nguyen
> > <[EMAIL PROTECTED]> wrote:
> >> I'm working on bringing up a second test cluster and am getting these intermittent errors on the DataNodes:
> >>
> >> 2010-05-12 17:17:15,094 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.FileNotFoundException: /srv/hadoop/dfs/1/current/VERSION (No such file or directory)
> >>        at java.io.RandomAccessFile.open(Native Method)
> >>        at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
> >>        at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:249)
> >>        at org.apache.hadoop.hdfs.server.common.Storage$StorageDirectory.write(Storage.java:243)
> >>        at org.apache.hadoop.hdfs.server.common.Storage.writeAll(Storage.java:689)
> >>        at org.apache.hadoop.hdfs.server.datanode.DataNode.register(DataNode.java:560)
> >>        at org.apache.hadoop.hdfs.server.datanode.DataNode.runDatanodeDaemon(DataNode.java:1230)
> >>        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1273)
> >>        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1394)
> >>
> >>
> >> There are 4 slaves and sometimes 1 or 2 have the error but the specific nodes change.  Sometimes it's slave1, sometimes it's slave4, etc.
> >>
> >> Any thoughts?
> >>
> >> Thanks!
> >>
> >> --Andrew
> >
> >
> >
> > --
> > Best Regards
> >
> > Jeff Zhang
>

--
Best Regards

Jeff Zhang