Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> YAMLException in the elasticsearch sink

Copy link to this message
Re: YAMLException in the elasticsearch sink
Hi Allan,
Ok - that looks to be good enough to raise a defect report - so I have:

Feel free to review, edit and add details.

I don't believe I can justify using my employer's time to fix this so
hopefully others may feel moved to fix it.


"After even further investigation, it seems the ContentBuilderUtil
calls org.elasticsearch.
common.xcontent.XContentFactory, specifically the xContentType method seen


If that function returns null, then it just tries to force the data to be a
string, otherwise it does some magic parsing based on the contentType. I
believe that this is where the problem happens. The xContentType function
thinks my string is YAML, then the YAML parser fails and isn't caught. Does
it make sense to have the try/catch in addComplexField catch the YAML
exception and fall back to using a addSimpleField? It seems the code
already does this for JSON related exceptions.