Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - flume 0.9.4 windows version out of memory


Copy link to this message
-
Re: flume 0.9.4 windows version out of memory
周梦想 2013-01-25, 08:34
I found that if I change windows agent configure
fromtail("c:\\test.txt") agentSink("hadoop48",35853)
;to
tail("c:\\test.txt")agentDFOSink("hadoop48",35853) ;
then the agent changes status from OPENING to ACTIVE.
my windows agent is :192.168.20.81, while linux collector is : 192.168.10.48
another linux agent is 192.168.10.46. 10.46 have no problem of agentSink.

Thanks!
Andy.

2013/1/25 周梦想 <[EMAIL PROTECTED]>

> when i start the flume node service,the agent is OPENING.
> Hello,
>
> I need to gather logs from windows 7, but the flume master and collector
> is running on linux. I download 0.9.4 exe file from flume official web.
>
> When I start the node from windows, the status is OPENING.
>
> zhouhh.TKOffice.localzhouhh.TKOffice.local zhouhh.TKOffice.localOPENINGFri
> Jan 25 11:45:01 CST 2013 4
>
> And the log reports OutOfMemoryError.
>
> ===============> D:\Program Files\Cloudera\Flume 0.9.4\log\flumenode-stdout.2013-01-25.log
>
> 2013-01-25 15:31:03 Commons Daemon procrun stdout initializedListening for
> transport dt_socket at address: 8888
> java.lang.OutOfMemoryError: Java heap space
> Dumping heap to java_pid8100.hprof ...
> Heap dump file created [13270531 bytes in 0.115 secs]
>
> ==============> D:\Program Files\Cloudera\Flume 0.9.4\log\flumenode-stderr.2013-01-25.log
>
> 2013-01-25 15:31:03 Commons Daemon procrun stderr initialized
> 13/01/25 15:31:03 INFO agent.FlumeNode: Flume 0.9.4
> 13/01/25 15:31:03 INFO agent.FlumeNode:  rev
> 8d0aa4be4ee50bb664cb0d1624e5634f46d7b62a
> 13/01/25 15:31:03 INFO agent.FlumeNode: Compiled  on  Mon Jun 20 14:46:53
> PDT 2011
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.runtime.name=Java(TM)
> SE Runtime Environment
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.boot.library.path=C:\PROGRA~1\Java\jre7\bin
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.version=23.3-b01
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.vendor=Oracle Corporation
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.vendor.url> http://java.oracle.com/
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property path.separator=;
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.vm.name=Java
> HotSpot(TM) Client VM
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property file.encoding.pkg> sun.io
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.country=CN
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.script> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.os.patch.level=Service Pack 1
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.specification.name=Java Virtual Machine Specification
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> user.dir=C:\Windows\system32
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.runtime.version=1.7.0_07-b11
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property flume> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.awt.graphicsenv=sun.awt.Win32GraphicsEnvironment
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.endorsed.dirs=C:\PROGRA~1\Java\jre7\lib\endorsed
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property os.arch=x86
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.io.tmpdir=C:\Windows\TEMP\
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property line.separator>
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.specification.vendor=Oracle Corporation
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.variant> 13/01/25 15:31:03 INFO agent.FlumeNode: System property os.name=Windows 7
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> flume.home=d:\PROGRA~1\Cloudera\FLUME0~1.4\bin\..
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.jnu.encoding=GBK
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.library.path=d:\PROGRA~1\Cloudera\FLUME0~1.4\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program