Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Review Request 16107: FLUME-2155: Improve replay time


Copy link to this message
-
Re: Review Request 16107: FLUME-2155: Improve replay time

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/16107/
-----------------------------------------------------------

(Updated Dec. 13, 2013, 5:08 p.m.)
Review request for Flume and Hari Shreedharan.
Changes
-------

Sorry, I was on battery power before so I didn't run all tests. Fixes failed tests.
Bugs: FLUME-2155
    https://issues.apache.org/jira/browse/FLUME-2155
Repository: flume-git
Description
-------

Adds a temporary btree based set of entries in the FEQ to check before doing a linear scan during full replay.
Diffs (updated)
-----

  flume-ng-channels/flume-file-channel/pom.xml e055d8a
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/CheckpointRebuilder.java 7883d0e
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/EventQueueBackingStoreFile.java 2366cbc
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannel.java 36f150b
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FlumeEventQueue.java ac03fb4
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java 8a8cb7f
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/LogFile.java 62f68c6
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/ReplayHandler.java c8f5fdd
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Serialization.java f8160d9
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestCheckpoint.java 1e0230d
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestCheckpointRebuilder.java 536af54
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestEventQueueBackingStoreFactory.java dfb3bf9
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestFlumeEventQueue.java 203cbf2
  pom.xml 267925f

Diff: https://reviews.apache.org/r/16107/diff/
Testing
-------

Unit tests pass
Thanks,

Brock Noland