The version for the current cluster is Cloudera 0.20.2+228

A newer version of CDH 0.20.2+320 is installed on a new machine to be used as a new datanode. But it failed to join the cluster and the log is shown below. So, the build version of a data node has to be exactly the same as the namenode or older?

/************************************************************
STARTUP_MSG: Starting DataNode
STARTUP_MSG:   host = hostname/ip
STARTUP_MSG:   args = []
STARTUP_MSG:   version = 0.20.2+320
STARTUP_MSG:   build =  -r 9b72d268a0b590b4fd7d13aca17c1c453f8bc957; compiled by 'root' on Mon Jun 28 19:13:09 EDT 2010
************************************************************/
2010-08-23 15:29:13,832 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Incompatible build versions: namenode BV = cfc3233ece0769b11af9add328261295aaf4d1ad; datanode BV = 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
2010-08-23 15:29:13,936 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException: Incompatible build versions: namenode BV = cfc3233ece0769b11af9add328261295aaf4d1ad; datanode BV = 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
        at org.apache.hadoop.hdfs.server.datanode.DataNode.handshake(DataNode.java:459)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:291)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:232)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1363)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1318)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1326)
        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1448)

2010-08-23 15:29:13,937 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at hostname/ip
************************************************************/

Thanks,

Michael

CDH 0.20.2+320 isn't compatible with 0.20.2+228
You need to upgrade whole cluster.

On Mon, Aug 23, 2010 at 2:00 PM, jiang licht <[EMAIL PROTECTED]> wrote:

> The version for the current cluster is Cloudera 0.20.2+228
>
> A newer version of CDH 0.20.2+320 is installed on a new machine to be used
> as a new datanode. But it failed to join the cluster and the log is shown
> below. So, the build version of a data node has to be exactly the same as
> the namenode or older?
>
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG:   host = hostname/ip
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = 0.20.2+320
> STARTUP_MSG:   build =  -r 9b72d268a0b590b4fd7d13aca17c1c453f8bc957;
> compiled by 'root' on Mon Jun 28 19:13:09 EDT 2010
> ************************************************************/
> 2010-08-23 15:29:13,832 FATAL
> org.apache.hadoop.hdfs.server.datanode.DataNode: Incompatible build
> versions: namenode BV = cfc3233ece0769b11af9add328261295aaf4d1ad; datanode
> BV = 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
> 2010-08-23 15:29:13,936 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible build versions: namenode BV > cfc3233ece0769b11af9add328261295aaf4d1ad; datanode BV > 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.handshake(DataNode.java:459)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:291)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:232)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1363)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1318)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1326)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1448)
>
> 2010-08-23 15:29:13,937 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at hostname/ip
> ************************************************************/
>
> Thanks,
>
> Michael
>
>
>

Thanks Ted. I guess the simplest way to avoid breaking anything for now I can try yum downgrade the new version to the older one on the new data node machine. Hope that works.

Thanks,

Michael

--- On Mon, 8/23/10, Ted Yu <[EMAIL PROTECTED]> wrote:

From: Ted Yu <[EMAIL PROTECTED]>
Subject: Re: add new data node failed: incompatible build version (CDH3)
To: [EMAIL PROTECTED]
Date: Monday, August 23, 2010, 4:06 PM

CDH 0.20.2+320 isn't compatible with 0.20.2+228
You need to upgrade whole cluster.

On Mon, Aug 23, 2010 at 2:00 PM, jiang licht <[EMAIL PROTECTED]> wrote:

> The version for the current cluster is Cloudera 0.20.2+228
>
> A newer version of CDH 0.20.2+320 is installed on a new machine to be used
> as a new datanode. But it failed to join the cluster and the log is shown
> below. So, the build version of a data node has to be exactly the same as
> the namenode or older?
>
> /************************************************************
> STARTUP_MSG: Starting DataNode
> STARTUP_MSG:   host = hostname/ip
> STARTUP_MSG:   args = []
> STARTUP_MSG:   version = 0.20.2+320
> STARTUP_MSG:   build =  -r 9b72d268a0b590b4fd7d13aca17c1c453f8bc957;
> compiled by 'root' on Mon Jun 28 19:13:09 EDT 2010
> ************************************************************/
> 2010-08-23 15:29:13,832 FATAL
> org.apache.hadoop.hdfs.server.datanode.DataNode: Incompatible build
> versions: namenode BV = cfc3233ece0769b11af9add328261295aaf4d1ad; datanode
> BV = 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
> 2010-08-23 15:29:13,936 ERROR
> org.apache.hadoop.hdfs.server.datanode.DataNode: java.io.IOException:
> Incompatible build versions: namenode BV > cfc3233ece0769b11af9add328261295aaf4d1ad; datanode BV > 9b72d268a0b590b4fd7d13aca17c1c453f8bc957
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.handshake(DataNode.java:459)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:291)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:232)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1363)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1318)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1326)
>         at
> org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1448)
>
> 2010-08-23 15:29:13,937 INFO
> org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down DataNode at hostname/ip
> ************************************************************/
>
> Thanks,
>
> Michael
>
>
>