Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Kafka performance testing


Copy link to this message
-
Re: Kafka performance testing
Download the source and build from source

wget https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz
tar -xvf kafka-0.8.0-src.tgz
cd kafka-0.8.0-src.tgz
./sbt update
./sbt package
./sbt assembly-package-dependency

/*******************************************
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Wed, Jan 29, 2014 at 4:34 PM, Michael Popov <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I try to run Kafka performance tests on my hosts. I get this error message:
>
> [User@Client1 kafka_2.8.0-0.8.0]$ ./bin/kafka-producer-perf-test.sh
> Exception in thread "main" java.lang.NoClassDefFoundError:
> kafka/perf/ProducerPerformance
> Caused by: java.lang.ClassNotFoundException: kafka.perf.ProducerPerformance
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> Could not find the main class: kafka.perf.ProducerPerformance. Program
> will exit.
>
> The command line generated by the script looks like this:
>
> java -Xmx512M -server -XX:+UseCompressedOops -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
> -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC
> -Djava.awt.headless=true -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dcom.sun.management.jmxremote.ssl=false
> -Dlog4j.configuration=file:/home/User/work/kafka_2.8.0-0.8.0/bin/../config/tools-log4j.properties
> -cp
> :/home/User/work/kafka_2.8.0-0.8.0/bin/../core/target/scala-2.8.0/*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../perf/target/scala-2.8.0/kafka*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/jopt-simple-3.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/log4j-1.2.15.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-annotation-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-core-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-compiler.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-library.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-api-1.7.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-simple-1.6.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/snappy-java-1.0.4.1.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zkclient-0.3.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zookeeper-3.3.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../kafka_2.8.0-0.8.0.jar
> kafka.perf.ProducerPerformance
>
> I unzipped kafka_2.8.0-0.8.0.jar and verified that there is no perf
> subdirectory.
> Kafka deployment package was downloaded this morning from the official
> Apache mirror.
>
> How this problem can be solved?
>
> Thank you,
> Michael Popov
>
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB