Let me know how this works for you. I wrote that tool a while ago, but I ended up never actually using myself. ________________________________ From: Tianying Chang <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Sent: Thursday, February 6, 2014 10:06 PM Subject: Re: WALPlayer?
Never mind. Should use hbase command. :)
On Thu, Feb 6, 2014 at 9:53 PM, Tianying Chang <[EMAIL PROTECTED]> wrote:
I am trying to use snapshot+WALPlayer for HBase DR for our cluster in AWS. I am trying to do below to verify it, seems the new data is not being played into the new table. Anything wrong with my steps? 1. Populate TestTable using PeformanceEvaluation Tool 2. count the rows being written, 63277 row(s) 3. take a snapshot, then clone a table TestTable-cloned based on this snapshot. Count the row # and verified that is has same number of rows as TestTable 4. write more data to TestTable using PerformanceEvaluation 5. count the row of TestTable, which has more rows. 6. call WALPlayer: su tychang hbase org.apache.hadoop.hbase.mapreduce.WALPlayer /hbase/.logs TestTable-cloned 7. count the row of TestTable-cloned. Find the row count is not changed, still 63277 row(s) :(
I suspect that the WAL is not rolled yet, so WALPlayer cannot replay those data. So I populated more data to make sure the WAL log rolled.(I can see the count of hlogs increased by 10) But still, after running WALPlayer, the rowCount is not changed. Any idea? Can WALPlayer work with Snapshot?
Thanks Tian-Ying On Fri, Feb 7, 2014 at 10:31 AM, Tianying Chang <[EMAIL PROTECTED]> wrote: