Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HBase, mail # user - cannot create a table having a snappy compression algorithm in mac os x.


Copy link to this message
-
cannot create a table having a snappy compression algorithm in mac os x.
Henry JunYoung KIM 2012-09-05, 11:35
Hi, hbase users.

I have a problem to create a table with a snappy algorithm in Mac OS X (lion).

I am sure that there is a snappy jar file in $HBASE_HOME/lib, but, it couldn't create it without errors.

environment :
hbase vesion : 0.92.1
distribution mode : pseudo-distributed (1 master, 1 region-server)

region server log :
2012-09-05 20:28:11,882 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
java.io.IOException: Compression algorithm 'snappy' previously failed test.
at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:78)
at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:3237)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3226)
at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3176)
at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:331)
at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:107)
at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:680)

master log :
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783., src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,570 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_FAILED_OPEN, server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED event for 1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE; was=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. state=CLOSED, ts=1346844678571, server=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:60000-0x139961fb9f00000 Creating (or updating) unassigned node for 1fa032ecf18ef9d194cc619f0205f783 with OFFLINE state
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=M_ZK_REGION_OFFLINE, server=192.168.162.80,60000,1346843415199, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783., src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,575 ERROR org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment in: 192.168.162.80,60020,1346843417187 due to org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. ,which we are already trying to OPEN.
org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. ,which we are already trying to OPEN.
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1624)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1329)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1304)
at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1299)
at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:102)
at org.apache.hadoop.hbase.executor.EventHandl