Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # dev >> Review Request: Flume adopt message from existing local Scribe

Copy link to this message
Re: Review Request: Flume adopt message from existing local Scribe

This is an automatically generated e-mail. To reply, visit:

(Updated Aug. 14, 2012, 6:53 a.m.)
Review request for Flume and Hari Shreedharan.

1. Moves from legacy to unified source folder(flume-ng-sources/flume-scribe-source)
2. Protects exception from ChannelSelector
3. Using THsHaServer to replace TNonblockingServer (multiple consuming thread)
4. Using SourceCounter
5. Asynchronous server initialization to avoid the problem listed at https://issues.apache.org/jira/browse/FLUME-1481

Detailed documentation changes will be posted into JIRA with doc-patch

There may someone like me that want to replace central Scribe with Flume to adopt existing ingest system, using smooth changes for application user.
Here is the ScribeSource put into legacy folder without deserializing.
This addresses bug https://issues.apache.org/jira/browse/FLUME-1382.
Diffs (updated)

  trunk/flume-ng-dist/pom.xml 1370121
  trunk/flume-ng-sources/flume-scribe-source/pom.xml PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/LogEntry.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/ResultCode.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/Scribe.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/ScribeSource.java PRE-CREATION
  trunk/flume-ng-sources/pom.xml PRE-CREATION
  trunk/pom.xml 1370121

Diff: https://reviews.apache.org/r/6089/diff/

I already used ScribeSource into local environment and tested in past week. It can use the existing local Scribe interface

Denny Ye