Hi Devs

I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.

I got the following exception
java.io.IOException: Failed on local exception:
com.google.protobuf.InvalidProtocolBufferException: Message missing
required fields: callId, status; Host Details : local host is: "ram/
10.239.47.144"; destination host is: "localhost":9000;
at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
at org.apache.hadoop.ipc.Client.call(Client.java:1168)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
at $Proxy10.setSafeMode(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
at $Proxy10.setSafeMode(Unknown Source)
at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
at
org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
at
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
at
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
at
org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
at java.lang.Thread.run(Thread.java:662)
Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
missing required fields: callId, status
at
com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
at
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
at
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
at
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting

I tried if there was something similar raised in the dev list.  Could not
find one.
But when i tried with hadoop - 1.0.4 it worked fine.
Did anyone face this problem?

Regards
Ram

The exception was from hadoop layer - when waiting to get out of safe mode.
Here is the call:

    } catch (Exception e) {

      if (e instanceof IOException) throw (IOException) e;      // Check
whether dfs is on safemode.

      inSafeMode = dfs.setSafeMode(

        org.apache.hadoop.hdfs.protocol.FSConstants.SafeModeAction.
SAFEMODE_GET);
I wish we had logged the exception prior to the call. Looks like
setSafeMode() with boolean parameter is not supported.

Cheers

On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> Hi Devs
>
> I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>
> I got the following exception
> java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Message missing
> required fields: callId, status; Host Details : local host is: "ram/
> 10.239.47.144"; destination host is: "localhost":9000;
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> at
>
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> at $Proxy10.setSafeMode(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> at
>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> at $Proxy10.setSafeMode(Unknown Source)
> at
>
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> at
>
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> missing required fields: callId, status
> at
>
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
>
> I tried if there was something similar raised in the dev list.  Could not
> find one.
> But when i tried with hadoop - 1.0.4 it worked fine.
> Did anyone face this problem?
>
> Regards
> Ram
>

I thought it was something to do with the ProtoBuf layer between RPC client
and server.  But not sure.

Regards
Ram

On Thu, Feb 21, 2013 at 9:12 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> The exception was from hadoop layer - when waiting to get out of safe mode.
> Here is the call:
>
>     } catch (Exception e) {
>
>       if (e instanceof IOException) throw (IOException) e;      // Check
> whether dfs is on safemode.
>
>       inSafeMode = dfs.setSafeMode(
>
>         org.apache.hadoop.hdfs.protocol.FSConstants.SafeModeAction.
> SAFEMODE_GET);
> I wish we had logged the exception prior to the call. Looks like
> setSafeMode() with boolean parameter is not supported.
>
> Cheers
>
> On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
> > Hi Devs
> >
> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> >
> > I got the following exception
> > java.io.IOException: Failed on local exception:
> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > required fields: callId, status; Host Details : local host is: "ram/
> > 10.239.47.144"; destination host is: "localhost":9000;
> > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > at
> >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at
> >
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > at
> >
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > at
> >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > missing required fields: callId, status
> > at
> >
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> > at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> >
> > I tried if there was something similar raised in the dev list.  Could not

I am remembering that there was some discussion around use of
dfs.setSafeMode() recently. Which issue I forgot

-Anoop-

On Thu, Feb 21, 2013 at 9:12 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> The exception was from hadoop layer - when waiting to get out of safe mode.
> Here is the call:
>
>     } catch (Exception e) {
>
>       if (e instanceof IOException) throw (IOException) e;      // Check
> whether dfs is on safemode.
>
>       inSafeMode = dfs.setSafeMode(
>
>         org.apache.hadoop.hdfs.protocol.FSConstants.SafeModeAction.
> SAFEMODE_GET);
> I wish we had logged the exception prior to the call. Looks like
> setSafeMode() with boolean parameter is not supported.
>
> Cheers
>
> On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
> > Hi Devs
> >
> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> >
> > I got the following exception
> > java.io.IOException: Failed on local exception:
> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > required fields: callId, status; Host Details : local host is: "ram/
> > 10.239.47.144"; destination host is: "localhost":9000;
> > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > at
> >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at
> >
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > at
> >
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > at
> >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > missing required fields: callId, status
> > at
> >
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> > at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> >
> > I tried if there was something similar raised in the dev list.  Could not

Here was the issue:
HBASE-7715 FSUtils#waitOnSafeMode can incorrectly loop on standby NN

On Thu, Feb 21, 2013 at 7:48 AM, Anoop John <[EMAIL PROTECTED]> wrote:

> I am remembering that there was some discussion around use of
> dfs.setSafeMode() recently. Which issue I forgot
>
> -Anoop-
>
> On Thu, Feb 21, 2013 at 9:12 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > The exception was from hadoop layer - when waiting to get out of safe
> mode.
> > Here is the call:
> >
> >     } catch (Exception e) {
> >
> >       if (e instanceof IOException) throw (IOException) e;      // Check
> > whether dfs is on safemode.
> >
> >       inSafeMode = dfs.setSafeMode(
> >
> >         org.apache.hadoop.hdfs.protocol.FSConstants.SafeModeAction.
> > SAFEMODE_GET);
> > I wish we had logged the exception prior to the call. Looks like
> > setSafeMode() with boolean parameter is not supported.
> >
> > Cheers
> >
> > On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
> > [EMAIL PROTECTED]> wrote:
> >
> > > Hi Devs
> > >
> > > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> > >
> > > I got the following exception
> > > java.io.IOException: Failed on local exception:
> > > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > > required fields: callId, status; Host Details : local host is: "ram/
> > > 10.239.47.144"; destination host is: "localhost":9000;
> > > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > > at
> > >
> > >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > > at $Proxy10.setSafeMode(Unknown Source)
> > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > at
> > >
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > > at
> > >
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > > at java.lang.reflect.Method.invoke(Method.java:597)
> > > at
> > >
> > >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > > at
> > >
> > >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> > > at $Proxy10.setSafeMode(Unknown Source)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> > > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> > > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > > at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > > at
> > >
> > >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> > > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > > at java.lang.Thread.run(Thread.java:662)
> > > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > > missing required fields: callId, status
> > > at
> > >
> > >
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> > > at
> > >
> > >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > > at
> > >
> > >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)

bq. But when i tried with hadoop - 1.0.4 it worked fine.

Just a guess: did you recompile code with hadoop 2.0 profile before trying ?
The fact that initialization failed with PB exception led to the above
question.

Cheers

On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> Hi Devs
>
> I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>
> I got the following exception
> java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Message missing
> required fields: callId, status; Host Details : local host is: "ram/
> 10.239.47.144"; destination host is: "localhost":9000;
> at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> at
>
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> at $Proxy10.setSafeMode(Unknown Source)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> at
>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> at $Proxy10.setSafeMode(Unknown Source)
> at
>
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> at
>
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> missing required fields: callId, status
> at
>
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> at
>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
>
> I tried if there was something similar raised in the dev list.  Could not
> find one.
> But when i tried with hadoop - 1.0.4 it worked fine.
> Did anyone face this problem?
>
> Regards
> Ram
>

YEs Ted.  I have two different setups with me .  One compiled with hadoop
2.0 and other with 1.0 profile.

Regards
Ram

On Thu, Feb 21, 2013 at 10:30 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> bq. But when i tried with hadoop - 1.0.4 it worked fine.
>
> Just a guess: did you recompile code with hadoop 2.0 profile before trying
> ?
> The fact that initialization failed with PB exception led to the above
> question.
>
> Cheers
>
> On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
> > Hi Devs
> >
> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> >
> > I got the following exception
> > java.io.IOException: Failed on local exception:
> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > required fields: callId, status; Host Details : local host is: "ram/
> > 10.239.47.144"; destination host is: "localhost":9000;
> > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > at
> >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > at
> >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > at
> >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> > at $Proxy10.setSafeMode(Unknown Source)
> > at
> >
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > at
> >
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> > at
> >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > at
> >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > missing required fields: callId, status
> > at
> >
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> > at
> >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> > at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> >
> > I tried if there was something similar raised in the dev list.  Could not
> > find one.
> > But when i tried with hadoop - 1.0.4 it worked fine.
> > Did anyone face this problem?
> >
> > Regards
> > Ram
> >
>

I tried this by recompiling once again.  I end up in same problem.  Not
sure what am i missing?
Any hints or clues?

Regards
Ram

On Fri, Feb 22, 2013 at 7:56 AM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> YEs Ted.  I have two different setups with me .  One compiled with hadoop
> 2.0 and other with 1.0 profile.
>
> Regards
> Ram
>
>
> On Thu, Feb 21, 2013 at 10:30 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
>> bq. But when i tried with hadoop - 1.0.4 it worked fine.
>>
>> Just a guess: did you recompile code with hadoop 2.0 profile before
>> trying ?
>> The fact that initialization failed with PB exception led to the above
>> question.
>>
>> Cheers
>>
>> On Thu, Feb 21, 2013 at 7:24 AM, ramkrishna vasudevan <
>> [EMAIL PROTECTED]> wrote:
>>
>> > Hi Devs
>> >
>> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>> >
>> > I got the following exception
>> > java.io.IOException: Failed on local exception:
>> > com.google.protobuf.InvalidProtocolBufferException: Message missing
>> > required fields: callId, status; Host Details : local host is: "ram/
>> > 10.239.47.144"; destination host is: "localhost":9000;
>> > at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
>> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
>> > at
>> >
>> >
>> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
>> > at $Proxy10.setSafeMode(Unknown Source)
>> > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> > at
>> >
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> > at java.lang.reflect.Method.invoke(Method.java:597)
>> > at
>> >
>> >
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
>> > at
>> >
>> >
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>> > at $Proxy10.setSafeMode(Unknown Source)
>> > at
>> >
>> >
>> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
>> > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
>> > at
>> >
>> >
>> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
>> > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
>> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
>> > at
>> >
>> >
>> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
>> > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
>> > at java.lang.Thread.run(Thread.java:662)
>> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
>> > missing required fields: callId, status
>> > at
>> >
>> >
>> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
>> > at
>> >
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
>> > at
>> >
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
>> > at
>> >
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
>> > at
>> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
>> > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
>> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:

Just to add on

As i said i have two setups.  Verified the HBase lib dir in these two
setups.  The one complied with profile 2.0 has hadoop 2.0 jars.  And the
one compiled with profile 1.0 has hadoop 1.0 jars.

I used to ways of creating and compiling this package
mvn clean install -Dhadoop.profile=2.0 -DskipTests assembly:assembly
mvn -X -DskipTests help:active-profiles package assembly:assembly -Prelease
-Dhadoop.profile=2.0

Both did not help me.

>From the logs i can see that the FileSystem.get() works fine.
But when the DFSClient in master and the NN talks to each other, the MAster
sends hostname/ip. whereas the NN replies with hostname:port.

Contents of core-site.xml
===================<configuration>
<property>
    <name>fs.defaultFS</name>
    <value>hdfs://localhost:9000</value>
     </property>

</configuration>
Contents of hdfs-site.xml
====================<configuration>
<property>
    <name>dfs.namenode.name.dir</name>
    <value>/home/ram/datadir</value>
     </property>
</configuration>
Content of hbase-site.xml
======================<configuration>
 <property>
    <name>hbase.rootdir</name>
    <value>hdfs://localhost:9000/hbase</value>
  </property>
  <property>
    <name>hbase.cluster.distributed</name>
    <value>true</value>
  </property>
  <property>
    <name>hbase.zookeeper.quorum</name>
    <value>localhost</value>
  </property>
</configuration>

This is just a single node machine.  Also am trying out the HBase trunk
with hadoop 2.0 for the first time.

Regards
Ram
On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> Hi Devs
>
> I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>
> I got the following exception
> java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Message missing
> required fields: callId, status; Host Details : local host is: "ram/
> 10.239.47.144"; destination host is: "localhost":9000;
>  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> at org.apache.hadoop.ipc.Client.call(Client.java:1168)
>  at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> at $Proxy10.setSafeMode(Unknown Source)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>  at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>  at $Proxy10.setSafeMode(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
>  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
>  at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
>  at
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
>  at
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
>  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> missing required fields: callId, status
> at
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
>  at
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)

During this time NN says

Incorrect header or version mismatch from 127.0.0.1:34789 got version 7
expected version 8

Regards
Ram
On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> Hi Devs
>
> I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>
> I got the following exception
> java.io.IOException: Failed on local exception:
> com.google.protobuf.InvalidProtocolBufferException: Message missing
> required fields: callId, status; Host Details : local host is: "ram/
> 10.239.47.144"; destination host is: "localhost":9000;
>  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> at org.apache.hadoop.ipc.Client.call(Client.java:1168)
>  at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> at $Proxy10.setSafeMode(Unknown Source)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>  at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
>  at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>  at $Proxy10.setSafeMode(Unknown Source)
> at
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
>  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> at
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
>  at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
>  at
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> at
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
>  at
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
>  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> missing required fields: callId, status
> at
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
>  at
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> at
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
>  at
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
>  at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
>
> I tried if there was something similar raised in the dev list.  Could not
> find one.
> But when i tried with hadoop - 1.0.4 it worked fine.
> Did anyone face this problem?
>
> Regards
> Ram
>

This indicates that the hadoop 2.0 HBase got built with lags the binary
running as Namenode.

Cheers

On Thu, Feb 21, 2013 at 8:42 PM, ramkrishna vasudevan <
[EMAIL PROTECTED]> wrote:

> During this time NN says
>
> Incorrect header or version mismatch from 127.0.0.1:34789 got version 7
> expected version 8
>
> Regards
> Ram
>
>
> On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
> > Hi Devs
> >
> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> >
> > I got the following exception
> > java.io.IOException: Failed on local exception:
> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > required fields: callId, status; Host Details : local host is: "ram/
> > 10.239.47.144"; destination host is: "localhost":9000;
> >  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> >  at
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > at $Proxy10.setSafeMode(Unknown Source)
> >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > at
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >  at
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > at java.lang.reflect.Method.invoke(Method.java:597)
> >  at
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > at
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> >  at $Proxy10.setSafeMode(Unknown Source)
> > at
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> >  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > at
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> >  at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> >  at
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > at
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> >  at
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > at
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> >  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > at java.lang.Thread.run(Thread.java:662)
> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > missing required fields: callId, status
> > at
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> >  at
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > at
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> >  at
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> > at
> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> >  at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> > Aborting
> >
> > I tried if there was something similar raised in the dev list.  Could not
> > find one.
> > But when i tried with hadoop - 1.0.4 it worked fine.
> > Did anyone face this problem?
> >
> > Regards
> > Ram
> >
>

hadoop-2.0.3-alpha is the HDFS that am running.

REgards
Ram

On Fri, Feb 22, 2013 at 10:26 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> This indicates that the hadoop 2.0 HBase got built with lags the binary
> running as Namenode.
>
> Cheers
>
> On Thu, Feb 21, 2013 at 8:42 PM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
> > During this time NN says
> >
> > Incorrect header or version mismatch from 127.0.0.1:34789 got version 7
> > expected version 8
> >
> > Regards
> > Ram
> >
> >
> > On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
> > [EMAIL PROTECTED]> wrote:
> >
> > > Hi Devs
> > >
> > > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> > >
> > > I got the following exception
> > > java.io.IOException: Failed on local exception:
> > > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > > required fields: callId, status; Host Details : local host is: "ram/
> > > 10.239.47.144"; destination host is: "localhost":9000;
> > >  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > >  at
> > >
> >
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> > > at $Proxy10.setSafeMode(Unknown Source)
> > >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > > at
> > >
> >
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> > >  at
> > >
> >
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> > > at java.lang.reflect.Method.invoke(Method.java:597)
> > >  at
> > >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> > > at
> > >
> >
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> > >  at $Proxy10.setSafeMode(Unknown Source)
> > > at
> > >
> >
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> > >  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > > at
> > >
> >
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> > >  at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > > at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > >  at
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> > > at
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> > >  at
> > >
> >
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> > > at
> > >
> >
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> > >  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > > at java.lang.Thread.run(Thread.java:662)
> > > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> > > missing required fields: callId, status
> > > at
> > >
> >
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> > >  at
> > >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> > > at
> > >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> > >  at
> > >
> >
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
> > > at
> > org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
> > >  at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
> > > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
> > > Aborting
> > >
> > > I tried if there was something similar raised in the dev list.  Could

Ram:
Here is what we have in pom.xml:
    <hadoop-two.version>2.0.2-alpha</hadoop-two.version>

You can try the patch from HBASE-7904 and rebuild your HBase tar ball.

Cheers

On Thu, Feb 21, 2013 at 8:56 PM, Ted Yu <[EMAIL PROTECTED]> wrote:

> This indicates that the hadoop 2.0 HBase got built with lags the binary
> running as Namenode.
>
> Cheers
>
>
> On Thu, Feb 21, 2013 at 8:42 PM, ramkrishna vasudevan <
> [EMAIL PROTECTED]> wrote:
>
>> During this time NN says
>>
>> Incorrect header or version mismatch from 127.0.0.1:34789 got version 7
>> expected version 8
>>
>> Regards
>> Ram
>>
>>
>> On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
>> [EMAIL PROTECTED]> wrote:
>>
>> > Hi Devs
>> >
>> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
>> >
>> > I got the following exception
>> > java.io.IOException: Failed on local exception:
>> > com.google.protobuf.InvalidProtocolBufferException: Message missing
>> > required fields: callId, status; Host Details : local host is: "ram/
>> > 10.239.47.144"; destination host is: "localhost":9000;
>> >  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
>> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
>> >  at
>> >
>> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
>> > at $Proxy10.setSafeMode(Unknown Source)
>> >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> > at
>> >
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> >  at
>> >
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> > at java.lang.reflect.Method.invoke(Method.java:597)
>> >  at
>> >
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
>> > at
>> >
>> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
>> >  at $Proxy10.setSafeMode(Unknown Source)
>> > at
>> >
>> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
>> >  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
>> > at
>> >
>> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
>> >  at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
>> > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
>> >  at
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
>> > at
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
>> >  at
>> >
>> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
>> > at
>> >
>> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
>> >  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
>> > at java.lang.Thread.run(Thread.java:662)
>> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
>> > missing required fields: callId, status
>> > at
>> >
>> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
>> >  at
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
>> > at
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
>> >  at
>> >
>> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
>> > at
>> org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
>> >  at org.apache.hadoop.ipc.Client$Connection.run(Client.java:817)
>> > 2013-02-20 20:44:01,928 INFO org.apache.hadoop.hbase.master.HMaster:
>> > Aborting
>> >
>> > I tried if there was something similar raised in the dev list.  Could

It works now.  Thanks Ted for your time and help.

Regards
Ram

On Fri, Feb 22, 2013 at 10:48 AM, Ted Yu <[EMAIL PROTECTED]> wrote:

> Ram:
> Here is what we have in pom.xml:
>     <hadoop-two.version>2.0.2-alpha</hadoop-two.version>
>
> You can try the patch from HBASE-7904 and rebuild your HBase tar ball.
>
> Cheers
>
> On Thu, Feb 21, 2013 at 8:56 PM, Ted Yu <[EMAIL PROTECTED]> wrote:
>
> > This indicates that the hadoop 2.0 HBase got built with lags the binary
> > running as Namenode.
> >
> > Cheers
> >
> >
> > On Thu, Feb 21, 2013 at 8:42 PM, ramkrishna vasudevan <
> > [EMAIL PROTECTED]> wrote:
> >
> >> During this time NN says
> >>
> >> Incorrect header or version mismatch from 127.0.0.1:34789 got version 7
> >> expected version 8
> >>
> >> Regards
> >> Ram
> >>
> >>
> >> On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >> > Hi Devs
> >> >
> >> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3 alpha.
> >> >
> >> > I got the following exception
> >> > java.io.IOException: Failed on local exception:
> >> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> >> > required fields: callId, status; Host Details : local host is: "ram/
> >> > 10.239.47.144"; destination host is: "localhost":9000;
> >> >  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> >> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> >> >  at
> >> >
> >>
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
> >> > at $Proxy10.setSafeMode(Unknown Source)
> >> >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >> > at
> >> >
> >>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> >> >  at
> >> >
> >>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> >> > at java.lang.reflect.Method.invoke(Method.java:597)
> >> >  at
> >> >
> >>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
> >> > at
> >> >
> >>
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
> >> >  at $Proxy10.setSafeMode(Unknown Source)
> >> > at
> >> >
> >>
> org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafeMode(ClientNamenodeProtocolTranslatorPB.java:514)
> >> >  at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> >> > at
> >> >
> >>
> org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:660)
> >> >  at
> org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> >> > at
> org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> >> >  at
> >> >
> >>
> org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:389)
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:147)
> >> >  at
> >> >
> >>
> org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:131)
> >> > at
> >> >
> >>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654)
> >> >  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> >> > at java.lang.Thread.run(Thread.java:662)
> >> > Caused by: com.google.protobuf.InvalidProtocolBufferException: Message
> >> > missing required fields: callId, status
> >> > at
> >> >
> >>
> com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferException(UninitializedMessageException.java:81)
> >> >  at
> >> >
> >>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
> >> > at
> >> >
> >>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
> >> >  at
> >> >
> >>
> org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)

ramkrishna vasudevan <ramkrishna.s.vasudevan@...> writes:

>
> It works now.  Thanks Ted for your time and help.
>
> Regards
> Ram
>
> On Fri, Feb 22, 2013 at 10:48 AM, Ted Yu <yuzhihong@...> wrote:
>
> > Ram:
> > Here is what we have in pom.xml:
> >     <hadoop-two.version>2.0.2-alpha</hadoop-two.version>
> >
> > You can try the patch from HBASE-7904 and rebuild your HBase tar ball.
> >
> > Cheers
> >
> > On Thu, Feb 21, 2013 at 8:56 PM, Ted Yu <yuzhihong@...> wrote:
> >
> > > This indicates that the hadoop 2.0 HBase got built with lags the
binary
> > > running as Namenode.
> > >
> > > Cheers
> > >
> > >
> > > On Thu, Feb 21, 2013 at 8:42 PM, ramkrishna vasudevan <
> > > ramkrishna.s.vasudevan@...> wrote:
> > >
> > >> During this time NN says
> > >>
> > >> Incorrect header or version mismatch from 127.0.0.1:34789 got version
7
> > >> expected version 8
> > >>
> > >> Regards
> > >> Ram
> > >>
> > >>
> > >> On Thu, Feb 21, 2013 at 8:54 PM, ramkrishna vasudevan <
> > >> ramkrishna.s.vasudevan@...> wrote:
> > >>
> > >> > Hi Devs
> > >> >
> > >> > I tried to run HBase current trunk snapshot with Hadoop 2.0.3
alpha.
> > >> >
> > >> > I got the following exception
> > >> > java.io.IOException: Failed on local exception:
> > >> > com.google.protobuf.InvalidProtocolBufferException: Message missing
> > >> > required fields: callId, status; Host Details : local host is:
"ram/
> > >> > 10.239.47.144"; destination host is: "localhost":9000;
> > >> >  at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:760)
> > >> > at org.apache.hadoop.ipc.Client.call(Client.java:1168)
> > >> >  at
> > >> >
> > >>
> >
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.jav
a:202)
> > >> > at $Proxy10.setSafeMode(Unknown Source)
> > >> >  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> > >> > at
> > >> >
> > >>
> >
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
> > >> >  at
> > >> >
> > >>
> >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
> > >> > at java.lang.reflect.Method.invoke(Method.java:597)
> > >> >  at
> > >> >
> > >>
> >
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocati
onHandler.java:164)
> > >> > at
> > >> >
> > >>
> >
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHand
ler.java:83)
> > >> >  at $Proxy10.setSafeMode(Unknown Source)
> > >> > at
> > >> >
> > >>
> >
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.setSafe
Mode(ClientNamenodeProtocolTranslatorPB.java:514)
> > >> >  at
org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:1896)
> > >> > at
> > >> >
> > >>
> >
org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSyst
em.java:660)
> > >> >  at
> > org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:261)
> > >> > at
> > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:650)
> > >> >  at
> > >> >
> > >>
> >
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSyste
m.java:389)
> > >> > at
> > >> >
> > >>
> >
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayou
t(MasterFileSystem.java:147)
> > >> >  at
> > >> >
> > >>
> > org.apache.hadoop.hbase.master.MasterFileSystem.<init>
(MasterFileSystem.java:131)
> > >> > at
> > >> >
> > >>
> >
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:654
)
> > >> >  at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:476)
> > >> > at java.lang.Thread.run(Thread.java:662)
> > >> > Caused by: com.google.protobuf.InvalidProtocolBufferException:
Message
> > >> > missing required fields: callId, status
> > >> > at
> > >> >
> > >>
> >
com.google.protobuf.UninitializedMessageException.asInvalidProtocolBufferExc
eption(UninitializedMessageException.java:81)
> > >> >  at
> > >> >
> > >>
> >
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto
$Builder.buildParsed(RpcPayloadHeaderProtos.java:1094)
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto
$Builder.access$1300(RpcPayloadHeaderProtos.java:1028)
org.apache.hadoop.ipc.protobuf.RpcPayloadHeaderProtos$RpcResponseHeaderProto
.parseDelimitedFrom(RpcPayloadHeaderProtos.java:986)
org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:886)
org.apache.hadoop.hbase.master.HMaster:
Could

Hi Ram,

I encountered exactly the same issue and hope can get more details to solve
this.

I followed your post, and have done the following:
1. added the line  “<hadoop-two.version>2.0.2-alpha</hadoop-two.version>” to
hbase's pom.xml
2. Rebuilt with mvn clean install -Dhadoop.profile=2.0 -DskipTests
assembly:assembly

But I still encountered the same error.

(Also I tried to apply patch HBASE-7904， but don't know where to start
with).

Wonder if you can give more details on what you did so you problem is
solved?

Thanks.

Seth