Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # dev - Review Request: FLUME-1516. Use dual checkpoints in File Channel
Hari Shreedharan
2013-01-06, 10:13
Hari Shreedharan
2013-01-06, 22:19
Hari Shreedharan
2013-01-07, 00:31
Hari Shreedharan
2013-01-08, 19:23
Hari Shreedharan
2013-01-08, 22:30
Copy link to this message
-
Re: Review Request: FLUME-1516. Use dual checkpoints in File Channel
Hari Shreedharan 2013-01-07, 00:43

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/8847/
-----------------------------------------------------------

(Updated Jan. 7, 2013, 12:43 a.m.)
Review request for Flume.
Changes
-------

Test updates and check if backup was completed before attempting to restore. If none exists, then continue with what we do currently.
Description
-------

Added support for backing up the checkpoint and recover from that.
This addresses bug FLUME-1516.
    https://issues.apache.org/jira/browse/FLUME-1516
Diffs (updated)
-----

  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/EventQueueBackingStore.java 13b50da
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/EventQueueBackingStoreFactory.java a19bdb4
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/EventQueueBackingStoreFile.java 186b15a
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/EventQueueBackingStoreFileV3.java 451a9d4
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannel.java d921387
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannelConfiguration.java 24368b3
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FlumeEventQueue.java 74a2bc8
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Log.java 8a4201c
  flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/Serialization.java 7094d3c
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestFileChannelBase.java 3da09ab
  flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestFileChannelRestart.java ea57cdb

Diff: https://reviews.apache.org/r/8847/diff/
Testing
-------

Added unit tests to test the new feature. All current unit tests pass.
Thanks,

Hari Shreedharan