Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - About flume configuration


Copy link to this message
-
Re: About flume configuration
Denny Ye 2012-08-08, 11:24
It may be caused by failed initialization, does there have other exceptions?
No doubt from configuration

-Regards
Denny Ye

2012/8/8 Yanzhi.liu <[EMAIL PROTECTED]>

>     hello:
>  I have a error for the flume configuration.
> My configuration is:
> agent_foo.sources = tailsource-1 tailsource
> agent_foo.channels = memoryChannel-1 memoryChannel
> agent_foo.sinks = Sink-1 Sink
> agent_foo.sources.tailsource.type = exec
> #com.chinacache.cpis.sources.CpisSource
> agent_foo.sources.tailsource.command = tail -F /home/hadoop/text.txt
> agent_foo.sources.tailsource.channels = memoryChannel
> agent_foo.sources.tailsource.batchSize = 1
> agent_foo.channels.memoryChannel.type = file
> agent_foo.channels.memoryChannel.checkpointDir=/home/hadoop/c
> agent_foo.channels.memoryChannel.dataDirs=/home/hadoop/d
> agent_foo.sinks.Sink.type=avro
> agent_foo.sinks.Sink.channel=memoryChannel
> agent_foo.sinks.Sink.hostname=221.130.18.211
> agent_foo.sinks.Sink.port=4545
> agent_foo.sinks.Sink.batch-size=1
> agent_foo.sources.tailsource-1.type = exec
> #com.chinacache.cpis.sources.CpisSource
> agent_foo.sources.tailsource-1.command = tail -F /home/hadoop/hello.txt
> agent_foo.sources.tailsource-1.channels = memoryChannel-1
> agent_foo.sources.tailsource-1.batchSize = 1
> agent_foo.channels.memoryChannel-1.type = file
> agent_foo.channels.memoryChannel-1.checkpointDir=/home/hadoop/a
> agent_foo.channels.memoryChannel-1.dataDirs=/home/hadoop/b
> agent_foo.sinks.Sink-1.type=avro
> agent_foo.sinks.Sink-1.channel=memoryChannel-1
> agent_foo.sinks.Sink-1.hostname=221.130.18.211
> agent_foo.sinks.Sink-1.port=4545
> agent_foo.sinks.Sink-1.batch-size=1
> But the log has error:
> 2012-08-08 19:11:44,886 ERROR flume.SinkRunner: Unable to deliver event.
> Exception follows.
> java.lang.IllegalStateException: Channel closed [channel=memoryChannel]
>         at
> com.google.common.base.Preconditions.checkState(Preconditions.java:145)
>         at
> org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:266)
>         at
> org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:118)
>         at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
>         at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>         at
> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>         at java.lang.Thread.run(Thread.java:662)
> 2012-08-08 19:11:49,891 ERROR flume.SinkRunner: Unable to deliver event.
> Exception follows.
> java.lang.IllegalStateException: Channel closed [channel=memoryChannel]
>         at
> com.google.common.base.Preconditions.checkState(Preconditions.java:145)
>         at
> org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:266)
>         at
> org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:118)
>         at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
>         at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
>         at
> org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
>         at java.lang.Thread.run(Thread.java:662)
> I want to know how to solve the problem.
> Thank you very much!
> My name
> Yanzhi Liu
>