Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Moving from Flume OG to Flume NG


Copy link to this message
-
Moving from Flume OG to Flume NG
Kumar, Deepak8 2012-10-05, 11:19
Hi Adam,
I am just trying to use hbase sink with flume. It is a sort of Hello World. My configuration file looks something like this. When I execute the node for hbase-agent, the log shows following error:

2012-10-05 06:55:05,330 ERROR hbase.HBaseSink: Could not load table, test from HBase

It seems, it looks for hbase at localhost, but the hbase is running on another VM. How should I provide the hbase VM details here? For testing purpose, I have created a hbase-site.xml at location flume/lib/ but it doesn't makes any different. My Hbase version is 0.92.1-cdh4.0.1 & Flume is 1.2.
Configuration File:

hbase-agent.sources = tail
hbase-agent.sinks = sink1
hbase-agent.channels = ch1
hbase-agent.sources.tail.type = exec
hbase-agent.sources.tail.command = tail -F /opt/sponge/flumeNG/jongkook.txt
hbase-agent.sources.tail.channels = ch1
hbase-agent.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
hbase-agent.sinks.sink1.channel = ch1
hbase-agent.sinks.sink1.table = test
hbase-agent.sinks.sink1.columnFamily = f1
hbase-agent.sinks.sink1.serializer = org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
hbase-agent.sinks.sink1.serializer.payloadColumn = col1
hbase-agent.sinks.sink1.serializer.keyType = timestamp
hbase-agent.sinks.sink1.serializer.rowPrefix = 1
hbase-agent.sinks.sink1.serializer.suffix = timestamp
hbase-agent.channels.ch1.type=memory

Regards,
Deepak
+
Brock Noland 2012-10-05, 14:35
+
Kumar, Deepak8 2012-10-05, 15:08
+
Brock Noland 2012-10-05, 15:17
+
Kumar, Deepak8 2012-10-05, 15:28
+
Brock Noland 2012-10-08, 16:02
+
Kumar, Deepak8 2012-10-09, 06:03
+
Brock Noland 2012-10-09, 14:51
+
Kumar, Deepak8 2012-09-18, 18:02
+
Brock Noland 2012-09-18, 18:05
+
Shumin Wu 2012-09-18, 18:10
+
Kumar, Deepak8 2012-10-03, 10:42
+
Shumin Wu 2012-10-03, 14:10