Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - 0.95.2 upgrade errors


Copy link to this message
-
Re: 0.95.2 upgrade errors
Kiru Pakkirisamy 2013-09-16, 20:00
Himanshu,
We did not have much data to move, so we did not use the migration script.
After using the (same) hadoop core jar in hbase and cleaning out the data (including zk) , I think I have a working cluster on ec2 now. Proceeding with loading data now. Thanks so much.
 
Regards,
- kiru
________________________________
 From: Himanshu Vashishtha <[EMAIL PROTECTED]>
To: Kiru Pakkirisamy <[EMAIL PROTECTED]>
Cc: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>; Ted Yu <[EMAIL PROTECTED]>
Sent: Monday, September 16, 2013 10:22 AM
Subject: Re: 0.95.2 upgrade errors
 

"13/09/16 02:13:39 WARN wal.HLogSplitter: Could not open
hdfs://ssp-master:8020/apps/hbase/data/WALs/ssp-region3,
60020,1379105062356-splitting/ssp-region3%2C60020%
2C1379105062356.1379105067148.meta for reading. File is empty"

This is okay as the file is empty. You can do a ls -l on the above file to
confirm.

The NPE needs to be looked into.  How is the master startup? Could you
pastebin the master log at startup?
You upgrade from a 94 installation? And using the migration script?
On Sun, Sep 15, 2013 at 11:47 PM, Kiru Pakkirisamy <
[EMAIL PROTECTED]> wrote:

> Himanshu et al,
> I see this error in one region. the .meta file is having a problem  I
> guess. Thanks for all the help.
>
> 13/09/16 02:13:39 WARN wal.HLogSplitter: Could not open
> hdfs://ssp-master:8020/apps/hbase/data/WALs/ssp-region3,60020,1379105062356-splitting/ssp-region3%2C60020%2C1379105062356.1379105067148.meta
> for reading. File is empty
> java.io.EOFException
>         at java.io.DataInputStream.readFully(DataInputStream.java:180)
>         at java.io.DataInputStream.readFully(DataInputStream.java:152)
>         at
> org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1512)
>         at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1490)
>         at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1479)
>         at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1474)
>         at
> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<init>(SequenceFileLogReader.java:69)
>         at
> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.reset(SequenceFileLogReader.java:174)
>         at
> org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.initReader(SequenceFileLogReader.java:183)
>         at
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.init(ReaderBase.java:64)
>         at
> org.apache.hadoop.hbase.regionserver.wal.HLogFactory.createReader(HLogFactory.java:126)
>         at
> org.apache.hadoop.hbase.regionserver.wal.HLogFactory.createReader(HLogFactory.java:89)
>
> and in the master I see
>
>  2013-09-16 02:33:28,755 [RpcServer.handler=27,port=60000] ERROR
> org.apache.hadoop.ipc.RpcServer.call - Unexpected throwable object
> java.lang.NullPointerException
>         at
> org.apache.hadoop.hbase.master.TableNamespaceManager.get(TableNamespaceManager.java:111)
>         at
> org.apache.hadoop.hbase.master.HMaster.getNamespaceDescriptor(HMaster.java:3116)
>         at
> org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1779)
>         at
> org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:1820)
>         at
> org.apache.hadoop.hbase.protobuf.generated.MasterAdminProtos$MasterAdminService$2.callBlockingMethod(MasterAdminProtos.java:27720)
>         at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2156)
>         at
> org.apache.hadoop.hbase.ipc.RpcServer$Handler.run(RpcServer.java:1861)
>
>
> Regards,
> - kiru
>
>   ------------------------------
>  *From:* Himanshu Vashishtha <[EMAIL PROTECTED]>
> *To:* [EMAIL PROTECTED]; Kiru Pakkirisamy <[EMAIL PROTECTED]>
> *Cc:* Ted Yu <[EMAIL PROTECTED]>
> *Sent:* Friday, September 13, 2013 4:18 PM
>
> *Subject:* Re: 0.95.2 upgrade errors
>
> Is there something odd (exceptions on starting) in Master logs? Does it
> start normally? You removed the above jar from HMaster node too? Could you