Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> Channel not starting.


+
JR 2013-03-21, 14:54
+
Zhiwen Sun 2013-03-21, 15:04
+
Brock Noland 2013-03-21, 15:04
Copy link to this message
-
Re: Channel not starting.
Thanks for replying:

OS: Linux SUSE 11.2
Java(TM) SE Runtime Environment (build pxa6460sr12-20121025_01(SR12))
J9 VM (build 2.4, JRE 1.6.0 IBM J9 2.4 Linux amd64-64
jvmxa6460sr12-20121024_126067 (JIT enabled, AOT enabled)
J9VM - 20121024_126067
JIT  - r9_20120914_26057
GC   - 20120928_AA)
JCL  - 20121014_01

#=============================================================================# Copied and  Modified the config info in
conf/flume-conf.properties.template
# as below:
#
# ======================================================================== agent1.sources = avroSource
 agent1.channels = ch1
 agent1.sinks = hdfsSink
#
 agent1.sources.avroSource.type = avro
 agent1.sources.avroSource.bind = 0.0.0.0
 agent1.sources.avroSource.port = 41414
 agent1.sources.avroSource.channels = ch1

# sink
 agent1.sinks.hdfsSink.type = hdfs
 agent1.sinks.hdfsSink.channel = ch1
 agent1.sinks.hdfsSink.hdfs.writeFormat = Text
 agent1.sinks.hdfsSink.hdfs.filePrefix =  testing
 agent1.sinks.hdfsSink.hdfs.path = hdfs://
hdtest111.svl.ibm.com:9000/flume/testingData  # please change "
hdtest111.svl.ibm.com" accordingly

# channels
 agent1.channels.ch1.type = memory
 agent1.channels.ch1.capacity = 1000
#
On Thu, Mar 21, 2013 at 11:04 AM, Brock Noland <[EMAIL PROTECTED]> wrote:

> Strange... Can you share 1) JVM 2) OS and 3) Flume config file?
>
>
> On Thu, Mar 21, 2013 at 7:54 AM, JR <[EMAIL PROTECTED]> wrote:
>
>> Hello,
>>
>>    Am a newbie, trying to set up acvro source, channel memory and hdfs
>> sink. Am encountering the following error: Not sure
>> what to do.
>>
>>    *Is there a way to 'search' the topics in the *
>>
>> 13/03/21 07:09:50 ERROR nodemanager.DefaultLogicalNodeManager: Error
>> while starting org.apache.flume.channel.MemoryChannel{name: ch1}
>> java.util.concurrent.RejectedExecutionException
>> at
>> java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:1779)
>> at
>> java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:778)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor.delayedExecute(ScheduledThreadPoolExecutor.java:226)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor.scheduleWithFixedDelay(ScheduledThreadPoolExecutor.java:454)
>> at
>> org.apache.flume.lifecycle.LifecycleSupervisor.supervise(LifecycleSupervisor.java:140)
>> at
>> org.apache.flume.node.nodemanager.DefaultLogicalNodeManager.startAllComponents(DefaultLogicalNodeManager.java:114)
>> at
>> org.apache.flume.conf.properties.PropertiesFileConfigurationProvider.load(PropertiesFileConfigurationProvider.java:225)
>> at
>> org.apache.flume.conf.file.AbstractFileConfigurationProvider.doLoad(AbstractFileConfigurationProvider.java:123)
>> at
>> org.apache.flume.conf.file.AbstractFileConfigurationProvider.access$300(AbstractFileConfigurationProvider.java:38)
>> at
>> org.apache.flume.conf.file.AbstractFileConfigurationProvider$FileWatcherRunnable.run(AbstractFileConfigurationProvider.java:202)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:452)
>> at
>> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:328)
>> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:161)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:109)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:191)
>> at
>> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:215)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:897)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:919)
>> at java.lang.Thread.run(Thread.java:738)
>> 13/03/21 07:09:50 INFO nodemanager.DefaultLogicalNodeManager: Waiting for
>> channel: ch1 to start. Sleeping for 500 ms
>> 13/03/21 07:09:50 INFO nodemanager.DefaultLogicalNodeManager: Waiting for
+
Brock Noland 2013-03-21, 16:13