Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # dev - Review Request 13509: FLUME-2089 ElasticsearchSink blocks and raises exceptions when event body has unexpected encoding


Copy link to this message
-
Review Request 13509: FLUME-2089 ElasticsearchSink blocks and raises exceptions when event body has unexpected encoding
Edward Sargisson 2013-08-12, 22:19

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/13509/
-----------------------------------------------------------

Review request for Flume.
Repository: flume-git
Description
-------

The ElasticsearchSink is quite aggressive in assuming that the incoming event is JSON. However, if it is not JSON or YAML then an exception is thrown which would block the queue from processing further messages.
This patch catches Exception and writes the data as a simple field.
Diffs
-----

  flume-ng-sinks/flume-ng-elasticsearch-sink/src/main/java/org/apache/flume/sink/elasticsearch/ContentBuilderUtil.java bf7c57c
  flume-ng-sinks/flume-ng-elasticsearch-sink/src/test/java/org/apache/flume/sink/elasticsearch/TestElasticSearchLogStashEventSerializer.java 9dff4b0

Diff: https://reviews.apache.org/r/13509/diff/
Testing
-------

Mvn install passes.
A custom build with this patch is currently running in many of our environments with no problems and the event which caused the issue was safely stored.
Thanks,

Edward Sargisson

+
Israel Ekpo 2013-08-25, 00:46
+
Israel Ekpo 2013-08-25, 00:48