Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase >> mail # user >> 0.95.2 upgrade errors


Copy link to this message
-
0.95.2 upgrade errors
We were able to migrate one cluster to 0.95.2 (from 0.94.11) without any problems.
But in another clusters, we have run into a few issues . Any pointers

13/09/13 07:57:09 FATAL wal.FSHLog: Could not sync. Requesting roll of hlog
java.io.IOException: DFSOutputStream is closed
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3845)
        at org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
        at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.sync(ProtobufLogWriter.java:135)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1075)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1013)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.sync(FSHLog.java:1186)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog$LogSyncer.run(FSHLog.java:964)
at java.lang.Thread.run(Thread.java:662)
13/09/13 07:57:09 ERROR wal.FSHLog: Error while syncing, requesting close of hlog
java.io.IOException: DFSOutputStream is closed
        at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.sync(DFSClient.java:3845)
        at org.apache.hadoop.fs.FSDataOutputStream.sync(FSDataOutputStream.java:97)
        at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogWriter.sync(ProtobufLogWriter.java:135)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1075)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.syncer(FSHLog.java:1013)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog.sync(FSHLog.java:1186)
        at org.apache.hadoop.hbase.regionserver.wal.FSHLog$LogSyncer.run(FSHLog.java:964)
        at java.lang.Thread.run(Thread.java:662)
13/09/13 07:57:09 INFO regionserver.HRegionServer: stopping server ssp-region1,60020,1379073423978; all regions closed.
13/09/13 07:57:10 INFO wal.FSHLog: RS_OPEN_META-ssp-region1:60020-0.logSyncer exiting
13/09/13 07:57:10 ERROR regionserver.HRegionServer: Metalog close and delete failed
java.io.IOException: IOException flush:org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.protocol.ClientProtocol.fsync(java.lang.String, java.lang.String)
        at java.lang.Class.getMethod(Class.java:1605)
        at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:581)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1444)
        at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1440)

and finally the region shuts down

13/09/13 07:57:10 INFO wal.FSHLog: regionserver60020.logSyncer exiting
13/09/13 07:57:10 INFO regionserver.Leases: regionserver60020 closing leases
13/09/13 07:57:10 INFO regionserver.Leases: regionserver60020 closed leases
13/09/13 07:57:15 INFO regionserver.HRegionServer$PeriodicMemstoreFlusher: regionserver60020.periodicFlusher exiting
13/09/13 07:57:15 INFO regionserver.Leases: regionserver60020.leaseChecker closing leases
13/09/13 07:57:15 INFO regionserver.Leases: regionserver60020.leaseChecker closed leases
13/09/13 07:57:15 INFO zookeeper.ZooKeeper: Session: 0x141172e5a590008 closed
13/09/13 07:57:15 INFO zookeeper.ClientCnxn: EventThread shut down
13/09/13 07:57:15 INFO regionserver.HRegionServer: stopping server ssp-region1,60020,1379073423978; zookeeper connection closed.
13/09/13 07:57:15 INFO regionserver.HRegionServer: regionserver60020 exiting
13/09/13 07:57:15 ERROR regionserver.HRegionServerCommandLine: Region server exiting
java.lang.RuntimeException: HRegionServer Aborted
        at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.start(HRegionServerCommandLine.java:66)
        at org.apache.hadoop.hbase.regionserver.HRegionServerCommandLine.run(HRegionServerCommandLine.java:85)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:78)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.main(HRegionServer.java:2309)
13/09/13 07:57:15 INFO regionserver.ShutdownHook: Shutdown hook starting; hbase.shutdown.hook=true; fsShutdownHook=Thread[Thread-4,5,main]

 
Regards,
- kiru
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB