Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # dev - Review Request: Flume adopt message from existing local Scribe


Copy link to this message
-
Re: Review Request: Flume adopt message from existing local Scribe
Denny Ye 2012-08-14, 06:53

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/6089/
-----------------------------------------------------------

(Updated Aug. 14, 2012, 6:53 a.m.)
Review request for Flume and Hari Shreedharan.
Changes
-------

1. Moves from legacy to unified source folder(flume-ng-sources/flume-scribe-source)
2. Protects exception from ChannelSelector
3. Using THsHaServer to replace TNonblockingServer (multiple consuming thread)
4. Using SourceCounter
5. Asynchronous server initialization to avoid the problem listed at https://issues.apache.org/jira/browse/FLUME-1481

Detailed documentation changes will be posted into JIRA with doc-patch
Description
-------

There may someone like me that want to replace central Scribe with Flume to adopt existing ingest system, using smooth changes for application user.
Here is the ScribeSource put into legacy folder without deserializing.
This addresses bug https://issues.apache.org/jira/browse/FLUME-1382.
    https://issues.apache.org/jira/browse/https://issues.apache.org/jira/browse/FLUME-1382
Diffs (updated)
-----

  trunk/flume-ng-dist/pom.xml 1370121
  trunk/flume-ng-sources/flume-scribe-source/pom.xml PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/LogEntry.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/ResultCode.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/Scribe.java PRE-CREATION
  trunk/flume-ng-sources/flume-scribe-source/src/main/java/org/apache/flume/source/scribe/ScribeSource.java PRE-CREATION
  trunk/flume-ng-sources/pom.xml PRE-CREATION
  trunk/pom.xml 1370121

Diff: https://reviews.apache.org/r/6089/diff/
Testing
-------

I already used ScribeSource into local environment and tested in past week. It can use the existing local Scribe interface
Thanks,

Denny Ye