Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # user - Table listed in "list", but not in .META.


Copy link to this message
-
Re: Table listed in "list", but not in .META.
Mohammad Tariq 2012-08-10, 23:34
Have you specified "hadoop.tmp.dir" property in your core-site.xml and
"dfs.data.dir" and "dfs.name.dir" properties in your hdfs-site.xml
files??
If not you will loose all your data along with you meta information as
Anil has said.

Regards,
    Mohammad Tariq
On Sat, Aug 11, 2012 at 5:01 AM, anil gupta <[EMAIL PROTECTED]> wrote:
> Where are you storing your hdfs data? Is it /tmp? If it's /tmp and you have
> rebooted your machined then you will have problems.
>
> On Fri, Aug 10, 2012 at 4:19 PM, Marco Gallotta <[EMAIL PROTECTED]>wrote:
>
>> It's a pseudo-distributed cluster, as I plan to add more nodes as we start
>> gathering more data.
>>
>> I get the following error when running hbck -repair, and then it stalls:
>>
>> 12/08/10 16:17:27 INFO util.HBaseFsck: Sleeping 10000ms before re-checking
>> after fix...
>> Version: 0.94.0
>> 12/08/10 16:17:37 INFO util.HBaseFsck: Loading regioninfos HDFS
>> 12/08/10 16:17:37 INFO util.HBaseFsck: Loading HBase regioninfo from
>> HDFS...
>> Exception in thread "main" java.util.concurrent.RejectedExecutionException
>> at
>> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:1956)
>> at
>> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:816)
>> at
>> java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1337)
>> at
>> org.apache.hadoop.hbase.util.HBaseFsck.loadHdfsRegionDirs(HBaseFsck.java:1059)
>> at
>> org.apache.hadoop.hbase.util.HBaseFsck.restoreHdfsIntegrity(HBaseFsck.java:504)
>> at
>> org.apache.hadoop.hbase.util.HBaseFsck.offlineHdfsIntegrityRepair(HBaseFsck.java:304)
>> at org.apache.hadoop.hbase.util.HBaseFsck.onlineHbck(HBaseFsck.java:377)
>> at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3139)
>>
>>
>>
>> --
>> Marco Gallotta | Mountain View, California
>> Software Engineer, Infrastructure | Loki Studios
>> fb.me/marco.gallotta | twitter.com/marcog
>> [EMAIL PROTECTED] | +1 (650) 417-3313
>>
>> Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
>>
>>
>> On Friday 10 August 2012 at 4:09 PM, anil gupta wrote:
>>
>> > Is it a standalone installation or pseudo-distributed?
>> > I faced a similar problem a few days back in a distributed cluster and
>> used
>> > hbck -repair option. You might give it a try.
>> >
>> > ~Anil
>> >
>> > On Fri, Aug 10, 2012 at 3:39 PM, Mohammad Tariq <[EMAIL PROTECTED](mailto:
>> [EMAIL PROTECTED])> wrote:
>> >
>> > > Could you please share your /etc/hosts file??Meantime, do a manual
>> > > compaction and see if ti works.
>> > >
>> > > Regards,
>> > > Mohammad Tariq
>> > >
>> > >
>> > > On Sat, Aug 11, 2012 at 4:07 AM, Marco Gallotta <[EMAIL PROTECTED](mailto:
>> [EMAIL PROTECTED])>
>> > > wrote:
>> > > > It's not a distributed cluster. I'm not processing enough data yet.
>> So
>> > >
>> > > the reference to localhost is correct.
>> > > >
>> > > > --
>> > > > Marco Gallotta | Mountain View, California
>> > > > Software Engineer, Infrastructure | Loki Studios
>> > > > fb.me/marco.gallotta (http://fb.me/marco.gallotta) |
>> twitter.com/marcog (http://twitter.com/marcog)
>> > > > [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED]) | +1 (650)
>> 417-3313
>> > > >
>> > > > Sent with Sparrow (http://www.sparrowmailapp.com/?sig)
>> > > >
>> > > >
>> > > > On Friday 10 August 2012 at 3:30 PM, anil gupta wrote:
>> > > >
>> > > > > Are you running a distributed cluster?
>> > > > > If yes, do you have localhost in /etc/hosts file?
>> > > > >
>> > > > > You are getting reference to localhost in hbck output:
>> > > > > ERROR: Region { meta => null, hdfs =>
>> > > > > hdfs://localhost:9000/hbase/test2/b0d4a5f294809c94fccb3d4ce10c3b23,
>> > > > > deployed => } on HDFS, but not listed in META or deployed on any
>> region
>> > > > > server
>> > > > >
>> > > > > ~Anil
>> > > > >
>> > > > > On Fri, Aug 10, 2012 at 3:08 PM, Marco Gallotta <
>> [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED])(mailto:
>> > > [EMAIL PROTECTED] (mailto:[EMAIL PROTECTED]))>wrote: