Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> keep event header when dump into hbase sink?


Copy link to this message
-
Re: keep event header when dump into hbase sink?
I would subclass HbaseEventSerializer for this purpose.

On Mon, Jan 7, 2013 at 10:33 AM, Xu (Simon) Chen <[EMAIL PROTECTED]> wrote:
> Hi all,
>
> Which hbase sink keeps the event header, and how to configure it to do so?
>
> The SimpleHbaseEventSerializer would certainly discard the header:
> https://github.com/apache/flume/blob/trunk/flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/SimpleHbaseEventSerializer.java
>
> It doesn't look like the RegexHbaseEventSerializer does anything either.
>
> Is there such an option, or do I have to implement my own serializer?
>
> Basically I have a syslog source where useful information is kept in the header:
>
> Event: { headers:{region=flp, timestamp=1357589618000, Severity=5,
> host=switch1, Facility=20} body: 45 62 72 61 3A 20 25 4C 49 4E 45 50
> 52 4F 54 4F Ebra: %LINEPROTO }
>
> Thanks.
> -Simon

--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/