Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> About flume configuration


Copy link to this message
-
Re: About flume configuration
It may be caused by failed initialization, does there have other exceptions?
No doubt from configuration

-Regards
Denny Ye

2012/8/8 Yanzhi.liu <[EMAIL PROTECTED]>

>     hello:
>  I have a error for the flume configuration.
> My configuration is:
> agent_foo.sources = tailsource-1 tailsource
> agent_foo.channels = memoryChannel-1 memoryChannel
> agent_foo.sinks = Sink-1 Sink
> agent_foo.sources.tailsource.type = exec
> #com.chinacache.cpis.sources.CpisSource
> agent_foo.sources.tailsource.command = tail -F /home/hadoop/text.txt
> agent_foo.sources.tailsource.channels = memoryChannel
> agent_foo.sources.tailsource.batchSize = 1
> agent_foo.channels.memoryChannel.type = file
> agent_foo.channels.memoryChannel.checkpointDir=/home/hadoop/c
> agent_foo.channels.memoryChannel.dataDirs=/home/hadoop/d
> agent_foo.sinks.Sink.type=avro
> agent_foo.sinks.Sink.channel=memoryChannel
> agent_foo.sinks.Sink.hostname=221.130.18.211
> agent_foo.sinks.Sink.port=4545
> agent_foo.sinks.Sink.batch-size=1
> agent_foo.sources.tailsource-1.type = exec
> #com.chinacache.cpis.sources.CpisSource
> agent_foo.sources.tailsource-1.command = tail -F /home/hadoop/hello.txt
> agent_foo.sources.tailsource-1.channels = memoryChannel-1
> agent_foo.sources.tailsource-1.batchSize = 1
> agent_foo.channels.memoryChannel-1.type = file
> agent_foo.channels.memoryChannel-1.checkpointDir=/home/hadoop/a
> agent_foo.channels.memoryChannel-1.dataDirs=/home/hadoop/b
> agent_foo.sinks.Sink-1.type=avro
> agent_foo.sinks.Sink-1.channel=memoryChannel-1
> agent_foo.sinks.Sink-1.hostname=221.130.18.211
> agent_foo.sinks.Sink-1.port=4545
> agent_foo.sinks.Sink-1.batch-size=1
> But the log has error:
> 2012-08-08 19:11:44,886 ERROR flume.SinkRunner: Unable to deliver event.
> Exception follows.
> java.lang.IllegalStateException: Channel closed [channel=memoryChannel]
>         at
> com.google.common.base.Preconditions.checkState(Preconditions.java:145)
>         at
> org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:266)
>         at
> org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:118)
>         at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
>         at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>         at
> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>         at java.lang.Thread.run(Thread.java:662)
> 2012-08-08 19:11:49,891 ERROR flume.SinkRunner: Unable to deliver event.
> Exception follows.
> java.lang.IllegalStateException: Channel closed [channel=memoryChannel]
>         at
> com.google.common.base.Preconditions.checkState(Preconditions.java:145)
>         at
> org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:266)
>         at
> org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:118)
>         at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
>         at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>         at
> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>         at java.lang.Thread.run(Thread.java:662)
> I want to know how to solve the problem.
> Thank you very much!
> My name
> Yanzhi Liu
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB