-Re: Review Request 18668: Support coalescing increments in HBaseSink
Mike Percy 2014-03-03, 05:09
This is an automatically generated e-mail. To reply, visit:
(Updated March 3, 2014, 5:09 a.m.)
Review request for Flume.
Fixed more HBase 0.96 issues
Coalesce support for HBaseSink. Also includes a BatchAware interface, allowing serializers that implement it to be aware of batching so that they can choose keys to optimize the effect of coalescing, if desired.
Added unit tests. Tested a version of this patch (prior to a rebase for trunk) under high load and the approach is very effective for certain high-increment workloads that end up with a lot of contention on keys in HBase.