Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HBase, mail # dev - HBase 0.90.4 missing data in production

Copy link to this message
Re: HBase 0.90.4 missing data in production
Cosmin Lehene 2011-11-07, 17:07
Dropping in.
Vladimir, can you check if there's any time skew between servers? (I can't
remember the exact details, but once we ended up with .META. region
location (cells) that were dated in the future because time was skewed on
some machine - so regions were not visible for a few hours)

Also, if you're willing to dig deeper, you could try loading individual
HFiles and counting the rows directly.


On 11/5/11 12:13 AM, "Stack" <[EMAIL PROTECTED]> wrote:

>On Fri, Nov 4, 2011 at 2:47 PM, Vladimir Rodionov
>> There are no ERRORs and FATALs in Region Servers logs except one FATAL
>>I have already posted. HLog sync
>> I am asking expert advise: what else should I check?
>8 rows out of 10k?
>Can you find what the 8 are?  Can you go do the src data to figure
>which?  Can you see anything in particular regards this 8 rows and
>say, those around them?  Once you have the 8 rows, can you see where
>they were inserted?  Can you figure time of insertion?  Can you see if
>anything happened to the data at that time?   Can you look in the
>regions?  Look at the hfiles under the region.  Use the tool here:
>http://hbase.apache.org/book.html#hfile_tool.  See if the rows are in