Now, there are scenarios where inconsistencies can happen. The edits are not necessarily shipped in order when there are failures.
So it is possible to have some Puts at T1 and some Deletes at T2 (T1 < T2), and end up with the deletes shipped first.
Now imagine a compaction happens at the slave after the Deletes are shipped to the slave, but before the Puts are shipped... The Puts will reappear.
From: Varun Sharma <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
Sent: Sunday, May 19, 2013 12:13 PM
Subject: Questions about HBase replication
I have a couple of questions about HBase replication...
1) When we ship edits to slave cluster - do we retain the timestamps in the
edits - if we don't, I can imagine hitting some inconsistencies ?
2) When a region server fails, the master renames the directory containing
WAL(s). Does this impact reading of those logs for replication ?