Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Java heap space error while starting flume agent


Copy link to this message
-
RE: Java heap space error while starting flume agent
Hi
Yea guava-10.0.1.jar is  there
When I put Flume guava 11.0.2 I did not get any error but my flume is not starting agent not giving any error too
It is hanged I guess
Regards,
Chhaya Vishwakarma

From: Ashish [mailto:[EMAIL PROTECTED]]
Sent: Friday, January 10, 2014 4:28 PM
To: [EMAIL PROTECTED]
Subject: Re: Java heap space error while starting flume agent

Guava should be already present in Flume lib directory. I downloaded and verified it. You should have guava-10.0.1.jar in Flume lib directory.

Can you try with a fresh Flume download? IMHO, it should work, then try to debug the broken env.

HTH!
ashish

On Fri, Jan 10, 2014 at 4:10 PM, Chhaya Vishwakarma <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>> wrote:
Hi,
My flume version is 1.4.0 and I have not put guava jar in classpath

-----Original Message-----
From: Wolfgang Hoschek [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Friday, January 10, 2014 3:51 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Re: Java heap space error while starting flume agent

Looks like you are running with a guava version that's different than the one that was used to compile. Flume uses guava 11.0.2 per flume/pom.xml.

Wolfgang.

On Jan 10, 2014, at 7:49 AM, Chhaya Vishwakarma wrote:

> Hi
> Thank you so much that error is gone now I am getting some different error
>
>
> java.lang.VerifyError: class com.google.common.cache.AbstractLoadingCache overrides final method apply.(Ljava/lang/Object;)Ljava/lang/Object;
>         at java.lang.ClassLoader.defineClass1(Native Method)
>         at java.lang.ClassLoader.defineClassCond(ClassLoader.java:631)
>         at java.lang.ClassLoader.defineClass(ClassLoader.java:615)
>         at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141)
>         at java.net.URLClassLoader.defineClass(URLClassLoader.java:283)
>         at java.net.URLClassLoader.access$000(URLClassLoader.java:58)
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:197)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
>         at com.cloudera.cdk.morphline.shaded.com.google.common.reflect.ClassPath$ClassInfo.load(ClassPath.java:226)
>         at com.cloudera.cdk.morphline.api.MorphlineContext.getTopLevelClasses(MorphlineContext.java:127)
>         at com.cloudera.cdk.morphline.api.MorphlineContext.importCommandBuilders(MorphlineContext.java:68)
>         at com.cloudera.cdk.morphline.stdlib.Pipe.<init>(Pipe.java:41)
>         at com.cloudera.cdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.java:39)
>         at com.cloudera.cdk.morphline.base.Compiler.compile(Compiler.java:125)
>         at com.cloudera.cdk.morphline.base.Compiler.compile(Compiler.java:54)
>         at org.apache.flume.sink.solr.morphline.MorphlineHandlerImpl.configure(MorphlineHandlerImpl.java:101)
>
>
> Regards,
> Chhaya Vishwakarma
>
>
> From: Joao Salcedo [mailto:[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
> Sent: Friday, January 10, 2014 11:10 AM
> To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
> Subject: Re: Java heap space error while starting flume agent
>
> Hi Chhaya,
>
> Assuming you are at flume home directory, here is the command to start:
>
>  bin/flume-ng agent -n agent -f conf/flume-conf.properties -c conf
>
> Flume starts and runs with a maximum heap size of 20mb. If you are using batching, you may run into out of memory error pretty quickly. To increase the heap size, rename the file  flume-env.sh.template  to flume-env.sh in conf directory and uncomment the JAVA_OPTS line and edit the minimum and maximum heap. Example: JAVA_OPTS="-Xms512m -Xmx1024m"
>
> If "-c conf" is not specified at the end of the command, your flume-env.sh file will not be taken into effect.

thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB