Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Getting header information and saving in hbase

Taimoor Aslam 2013-03-22, 11:58
Copy link to this message
Re: Getting header information and saving in hbase
Hari Shreedharan 2013-03-22, 22:51

You need to implement the HbaseEventSerializer (https://git-wip-us.apache.org/repos/asf?p=flume.git;a=blob;f=flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/HbaseEventSerializer.java;h=2c0f0e6c5a2d06d88b0ea0f3f11e3dee82243882;hb=HEAD) (for HBaseSink) or AsyncHbaseEventSerializer (https://git-wip-us.apache.org/repos/asf?p=flume.git;a=blob;f=flume-ng-sinks/flume-ng-hbase-sink/src/main/java/org/apache/flume/sink/hbase/AsyncHbaseEventSerializer.java;h=9ae6c289da8b01cf05b68811d1880515a2ad4169;hb=HEAD) (for AsyncHBaseSink) and return the Puts/Increments in the format you want.

Hari Shreedharan
On Friday, March 22, 2013 at 4:58 AM, Taimoor Aslam wrote:

> I used static interceptor and avro sink in client configuration to add custom information in headers , and in server configuration i used avro source and  hbase sink to save the data in hbase table, but only the contents in body of the event saved in table, and  i also want to save incoming key value pairs in headers. How to ?