Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - SplitLogManager issue


+
kun yan 2013-09-26, 02:31
Copy link to this message
-
Re: SplitLogManager issue
Jimmy Xiang 2013-09-26, 02:39
In the region server log, you should see the details about the failure.
On Wed, Sep 25, 2013 at 7:31 PM, kun yan <[EMAIL PROTECTED]> wrote:

> I use importtsv import data into HDFS, but during the power outage.
> Horrible, and then I re-import the data.(hbase 0.94)
>
> the exception
> org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find
> region for data2,04684015,99999999999999 after 10 tries.
>
> I look HMaster logs as follows:
>
> 2013-09-26 10:21:17,874 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:18,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:19,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:20,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:21,876 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:22,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:23,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:24,875 DEBUG
> org.apache.hadoop.hbase.master.SplitLogManager: total tasks = 1 unassigned
> = 0
> 2013-09-26 10:21:25,436 INFO
> org.apache.hadoop.hbase.master.SplitLogManager: task
>
> /hbase/splitlog/hdfs%3A%2F%2Fhydra0001%3A8020%2Fhbase%2F.logs%2Fhydra0006%2C60020%2C1379926437471-splitting%2Fhydra0006%252C60020%252C1379926437471.1380157500804
> entered state err hydra0004,60020,1380159614688
> 2013-09-26 10:21:25,436 WARN
> org.apache.hadoop.hbase.master.SplitLogManager: Error splitting
>
> /hbase/splitlog/hdfs%3A%2F%2Fhydra0001%3A8020%2Fhbase%2F.logs%2Fhydra0006%2C60020%2C1379926437471-splitting%2Fhydra0006%252C60020%252C1379926437471.1380157500804
> 2013-09-26 10:21:25,436 WARN
> org.apache.hadoop.hbase.master.SplitLogManager: error while splitting logs
> in
> [hdfs://hydra0001:8020/hbase/.logs/hydra0003,60020,1379926447350-splitting,
> hdfs://hydra0001:8020/hbase/.logs/hydra0004,60020,1379926440171-splitting,
> hdfs://hydra0001:8020/hbase/.logs/hydra0006,60020,1379926437471-splitting]
> installed = 2 but only 0 done
> 2013-09-26 10:21:25,436 WARN
> org.apache.hadoop.hbase.master.MasterFileSystem: Failed splitting of
> [hydra0003,60020,1379926447350, hydra0004,60020,1379926440171,
> hydra0006,60020,1379926437471]
> java.io.IOException: error or interrupted while splitting logs in
> [hdfs://hydra0001:8020/hbase/.logs/hydra0003,60020,1379926447350-splitting,
> hdfs://hydra0001:8020/hbase/.logs/hydra0004,60020,1379926440171-splitting,
> hdfs://hydra0001:8020/hbase/.logs/hydra0006,60020,1379926437471-splitting]
> Task = installed = 2 done = 0 error = 2
>         at
>
> org.apache.hadoop.hbase.master.SplitLogManager.splitLogDistributed(SplitLogManager.java:282)
>         at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.java:300)
>         at
>
> org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterFileSystem.java:242)
>         at
>
> org.apache.hadoop.hbase.master.HMaster.splitLogAfterStartup(HMaster.java:661)
>         at
>
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:580)
>         at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:396)
>         at java.lang.Thread.run(Thread.java:722)
>
> --
>
> In the Hadoop world, I am just a novice, explore the entire Hadoop
> ecosystem, I hope one day I can contribute their own code
>
> YanBit
> [EMAIL PROTECTED]
>
+
kun yan 2013-09-26, 02:52
+
Ted Yu 2013-09-26, 03:03
+
Julian Zhou 2013-09-27, 03:03