Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Hbase Sink


Configuration looks fine. HBASE_HOME and CLASSPATH are also important.
Please check these once.

Regards,
    Mohammad Tariq
On Thu, Jul 19, 2012 at 6:50 PM, prabhu k <[EMAIL PROTECTED]> wrote:
> Thanks for the quick response,
>
> Yes, i have exported HADOOP_HOME variable, anything needs to do?
>
> On Thu, Jul 19, 2012 at 6:41 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>
>> Hi Prabhu,
>>
>>    Have you exported HADOOP_HOME variable??
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>> On Thu, Jul 19, 2012 at 6:34 PM, prabhu k <[EMAIL PROTECTED]> wrote:
>> > Hi Users,
>> >
>> > I have followed the below link for move the sample data to hbase sink. i
>> > then executed the below command, I am getting following error output.
>> > pasted the flume.log log file.
>> >
>> > Please suggest and help on this issue.
>> >
>> >
>> > http://cloudfront.blogspot.in/2012/06/how-to-move-data-into-hbase-table-using.html
>> >
>> > command
>> > ==========>> > bin/flume-ng agent -n hbase-agent -c conf/ -f conf/hbase-agent.conf
>> >
>> >
>> > hbase-agent.conf
>> > =================>> > hbase-agent.sources = tail
>> > hbase-agent.sinks = sink1
>> > hbase-agent.channels = ch1
>> > hbase-agent.sources.tail.type = exec
>> > hbase-agent.sources.tail.command = tail -F /usr/local/demo.txt
>> > hbase-agent.sources.tail.channels = ch1
>> > hbase-agent.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
>> > hbase-agent.sinks.sink1.channel = ch1
>> > hbase-agent.sinks.sink1.table = demo
>> > hbase-agent.sinks.sink1.columnFamily = cf
>> > hbase-agent.sinks.sink1.serializer >> > org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
>> > hbase-agent.sinks.sink1.serializer.payloadColumn = col1
>> > hbase-agent.sinks.sink1.serializer.keyType = timestamp
>> > hbase-agent.sinks.sink1.serializer.rowPrefix = 1
>> > hbase-agent.sinks.sink1.serializer.suffix = timestamp
>> > hbase-agent.channels.ch1.type=memory
>> >
>> >
>> > flume.log
>> > ================>> > /flume/flume-1.2.0-incubating-SNAPSHOT# more flume.log
>> > 2012-07-19 18:24:58,007 INFO lifecycle.LifecycleSupervisor: Starting
>> > lifecycle supervisor 1
>> > 2012-07-19 18:24:58,008 INFO node.FlumeNode: Flume node starting -
>> > hbase-agent
>> > 2012-07-19 18:24:58,011 INFO nodemanager.DefaultLogicalNodeManager: Node
>> > manager starting
>> > 2012-07-19 18:24:58,011 INFO lifecycle.LifecycleSupervisor: Starting
>> > lifecycle supervisor 10
>> > 2012-07-19 18:24:58,011 INFO
>> > properties.PropertiesFileConfigurationProvider:
>> > Configuration provider starting
>> > 2012-07-19 18:24:58,013 INFO
>> > properties.PropertiesFileConfigurationProvider:
>> > Reloading configuration file:conf/hbase-agent.conf
>> > 2012-07-19 18:24:58,019 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Added sinks: sink1
>> > Agent: hbase-agent
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,020 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,021 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,021 INFO conf.FlumeConfiguration: Processing:sink1
>> > 2012-07-19 18:24:58,034 INFO conf.FlumeConfiguration: Post-validation
>> > flume
>> > configuration contains configuration  for agents: [hbase-agent]
>> > 2012-07-19 18:24:58,034 INFO
>> > properties.PropertiesFileConfigurationProvider:
>> > Creating channels
>> > 2012-07-19 18:24:58,038 INFO
>> > properties.PropertiesFileConfigurationProvider:
>> > created channel ch1
>> > 2012-07-19 18:24:58,046 INFO sink.DefaultSinkFactory: Creating instance
>> > of
>> > sink sink1 typeorg.apache.flume.sink.hbase.HBaseSink
>> > 2012-07-19 18:24:58,051 ERROR
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB