Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Hbase Sink


Hi George,

         We need to add the payload column as well.Add the following
line in your config file :
hbase-agent.sinks.sink1.serializer.payloadColumn = col_name

Regards,
    Mohammad Tariq
On Tue, Jul 17, 2012 at 8:23 PM, George Forman
<[EMAIL PROTECTED]> wrote:
> Hi all,
>
> Newbie here...I am trying to get flume ng to do a simple hbase sink.
> I have downloaded/installed flume-ng and configured it based on
> info found on the net. I don't see flume connecting to hbase.
> I am wondering what I could be missing?  - Thanks
>
> Here is my configuration:
>
> hbase-agent.sources = tail
> hbase-agent.sinks = sink1
> hbase-agent.channels = ch1
>
> hbase-agent.sources.tail.type = exec
> hbase-agent.sources.tail.bind = pseudo
> hbase-agent.sources.tail.command = tail -F /tmp/test-flume.ens
> hbase-agent.sources.tail.channels = ch1
>
> hbase-agent.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
> hbase-agent.sinks.sink1.channel = ch1
> hbase-agent.sinks.sink1.table = ens
> hbase-agent.sinks.sink1.columnFamily = raw
> hbase-agent.sinks.sink1.column = event
> hbase-agent.sinks.sink1.serializer > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
> hbase-agent.channels.ch1.type = memory
>
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB