Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume >> mail # user >> flume 0.9.4 windows version out of memory


+
周梦想 2013-01-25, 07:42
Copy link to this message
-
Re: flume 0.9.4 windows version out of memory
I found that if I change windows agent configure
fromtail("c:\\test.txt") agentSink("hadoop48",35853)
;to
tail("c:\\test.txt")agentDFOSink("hadoop48",35853) ;
then the agent changes status from OPENING to ACTIVE.
my windows agent is :192.168.20.81, while linux collector is : 192.168.10.48
another linux agent is 192.168.10.46. 10.46 have no problem of agentSink.

Thanks!
Andy.

2013/1/25 周梦想 <[EMAIL PROTECTED]>

> when i start the flume node service,the agent is OPENING.
> Hello,
>
> I need to gather logs from windows 7, but the flume master and collector
> is running on linux. I download 0.9.4 exe file from flume official web.
>
> When I start the node from windows, the status is OPENING.
>
> zhouhh.TKOffice.localzhouhh.TKOffice.local zhouhh.TKOffice.localOPENINGFri
> Jan 25 11:45:01 CST 2013 4
>
> And the log reports OutOfMemoryError.
>
> ===============> D:\Program Files\Cloudera\Flume 0.9.4\log\flumenode-stdout.2013-01-25.log
>
> 2013-01-25 15:31:03 Commons Daemon procrun stdout initializedListening for
> transport dt_socket at address: 8888
> java.lang.OutOfMemoryError: Java heap space
> Dumping heap to java_pid8100.hprof ...
> Heap dump file created [13270531 bytes in 0.115 secs]
>
> ==============> D:\Program Files\Cloudera\Flume 0.9.4\log\flumenode-stderr.2013-01-25.log
>
> 2013-01-25 15:31:03 Commons Daemon procrun stderr initialized
> 13/01/25 15:31:03 INFO agent.FlumeNode: Flume 0.9.4
> 13/01/25 15:31:03 INFO agent.FlumeNode:  rev
> 8d0aa4be4ee50bb664cb0d1624e5634f46d7b62a
> 13/01/25 15:31:03 INFO agent.FlumeNode: Compiled  on  Mon Jun 20 14:46:53
> PDT 2011
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.runtime.name=Java(TM)
> SE Runtime Environment
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.boot.library.path=C:\PROGRA~1\Java\jre7\bin
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.version=23.3-b01
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.vendor=Oracle Corporation
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.vendor.url> http://java.oracle.com/
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property path.separator=;
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property java.vm.name=Java
> HotSpot(TM) Client VM
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property file.encoding.pkg> sun.io
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.country=CN
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.script> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.os.patch.level=Service Pack 1
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.specification.name=Java Virtual Machine Specification
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> user.dir=C:\Windows\system32
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.runtime.version=1.7.0_07-b11
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property flume> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.awt.graphicsenv=sun.awt.Win32GraphicsEnvironment
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.endorsed.dirs=C:\PROGRA~1\Java\jre7\lib\endorsed
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property os.arch=x86
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.io.tmpdir=C:\Windows\TEMP\
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property line.separator>
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.vm.specification.vendor=Oracle Corporation
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property user.variant> 13/01/25 15:31:03 INFO agent.FlumeNode: System property os.name=Windows 7
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> flume.home=d:\PROGRA~1\Cloudera\FLUME0~1.4\bin\..
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> sun.jnu.encoding=GBK
> 13/01/25 15:31:03 INFO agent.FlumeNode: System property
> java.library.path=d:\PROGRA~1\Cloudera\FLUME0~1.4\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program
+
Jeong-shik Jang 2013-01-25, 09:21
+
周梦想 2013-01-28, 04:05
+
Jeong-shik Jang 2013-01-28, 06:49
+
Alexander Alten-Lorenz 2013-01-28, 07:07
+
周梦想 2013-01-28, 07:22
+
周梦想 2013-01-28, 07:41
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB