Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> YAMLException in the elasticsearch sink

Allan Feid 2013-06-10, 13:59
Edward Sargisson 2013-06-11, 16:33
Allan Feid 2013-06-12, 14:13
Edward Sargisson 2013-06-13, 16:13
Allan Feid 2013-06-13, 17:11
Allan Feid 2013-06-13, 19:33
Edward Sargisson 2013-06-12, 16:14
Allan Feid 2013-06-12, 16:47
Copy link to this message
Re: YAMLException in the elasticsearch sink
Hi Allan,
Ok - that looks to be good enough to raise a defect report - so I have:

Feel free to review, edit and add details.

I don't believe I can justify using my employer's time to fix this so
hopefully others may feel moved to fix it.


"After even further investigation, it seems the ContentBuilderUtil
calls org.elasticsearch.
common.xcontent.XContentFactory, specifically the xContentType method seen


If that function returns null, then it just tries to force the data to be a
string, otherwise it does some magic parsing based on the contentType. I
believe that this is where the problem happens. The xContentType function
thinks my string is YAML, then the YAML parser fails and isn't caught. Does
it make sense to have the try/catch in addComplexField catch the YAML
exception and fall back to using a addSimpleField? It seems the code
already does this for JSON related exceptions.

Allan Feid 2013-06-14, 16:13