| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
47 (0.076s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: flume-ng Unable to put batch on required channel error - Flume - [mail # user]
|
|
...thank you. I once increased hdfs batch size more than 1000, but it report the ChannelException more frequence. so I changed small and small, batch size to 50 is less error. 2013/3/1 Ha...
|
|
|
Author: 周梦想,
2013-03-01, 09:54
|
|
|
Re: flume-ng Unable to put batch on required channel error - Flume - [mail # user]
|
|
...Hello, I wrote a test java file to put local files to hdfs, it put 1.1GB files to hdfs spent about 35 seconds. while using flume, 100MB files it should spend about 3-5 minutes. why flu...
|
|
|
Author: 周梦想,
2013-03-01, 03:10
|
|
|
flume-ng Unable to put batch on required channel error - Flume - [mail # user]
|
|
...hello, I saw lot's of flume-ng 1.3.1 agent Exception said Unable to put batch on required channel,and then disconnected. what is the effect? lost data or duplicate data? What caused th...
|
|
|
Author: 周梦想,
2013-03-01, 02:16
|
|
|
Re: windows spooldir source problem - Flume - [mail # user]
|
|
...yes,we using windows cmd mv command to move the file and set it to the task schedule. I add a patch for windows flume to check if the file is writing : flume-ng 1.3.1 SpoolingFileLineR...
|
|
|
Author: 周梦想,
2013-03-01, 01:53
|
|
|
can we run flume-ng windows using hdfs sink? - Flume - [mail # user]
|
|
...I build a windows flume-ng, and wish it can directly extract data to hdfs, but it seems doesn't work. while avro sink is ok. error logs: 2013-02-27 15:15:34,448 (conf-file-poller-0) [...
|
|
|
Author: 周梦想,
2013-02-27, 07:18
|
|
|
windows spooldir source problem - Flume - [mail # user]
|
|
...Hello, I have a question using spooldir source. If I have a large file such as more than 100MB, when I copy this file to spooldir, the flume agent will find it immediately and begin se...
|
|
|
Author: 周梦想,
2013-02-27, 06:49
|
|
|
Re: Take list for MemoryTransaction, capacity 100 full？ - Flume - [mail # user]
|
|
...Hi Hari, here is my main configure: agent46.sources = userlogsrc gamelogsrc agent46.channels = memch1 agent46.sinks = myhdfssink agent46.sinks.myhdfssink.hdfs.batchSize = 50 agent46.c...
|
|
|
Author: 周梦想,
2013-02-27, 02:29
|
|
|
Re: Take list for MemoryTransaction, capacity 100 full？ - Flume - [mail # user]
|
|
...I found if agent46.sinks.myhdfssink.hdfs.batchSize >= 100, it will report this error. if I set this configure to 10, it's ok. but it's a bit slower. Best Regards, Andy 2013/2/...
|
|
|
Author: 周梦想,
2013-02-26, 07:41
|
|
|
Re: Take list for MemoryTransaction, capacity 100 full？ - Flume - [mail # user]
|
|
...more logs： 2013-02-26 14:37:00,380 (SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR - org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:160)] Unable to deliver event....
|
|
|
Author: 周梦想,
2013-02-26, 06:45
|
|
|
Take list for MemoryTransaction, capacity 100 full ？ - Flume - [mail # user]
|
|
...hello, I using flume-ng send data from windows to linux hdfs through avro protocol, and encountered this error: 2013-02-26 12:21:02,908 (pool-8-thread-1) [DEBUG - org.apache.flume.sour...
|
|
|
Author: 周梦想,
2013-02-26, 05:57
|
|
|
|
