Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Kafka performance testing


Copy link to this message
-
Re: Kafka performance testing
Joe Stein 2014-01-29, 21:38
Download the source and build from source

wget https://archive.apache.org/dist/kafka/0.8.0/kafka-0.8.0-src.tgz
tar -xvf kafka-0.8.0-src.tgz
cd kafka-0.8.0-src.tgz
./sbt update
./sbt package
./sbt assembly-package-dependency

/*******************************************
 Joe Stein
 Founder, Principal Consultant
 Big Data Open Source Security LLC
 http://www.stealth.ly
 Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
********************************************/
On Wed, Jan 29, 2014 at 4:34 PM, Michael Popov <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I try to run Kafka performance tests on my hosts. I get this error message:
>
> [User@Client1 kafka_2.8.0-0.8.0]$ ./bin/kafka-producer-perf-test.sh
> Exception in thread "main" java.lang.NoClassDefFoundError:
> kafka/perf/ProducerPerformance
> Caused by: java.lang.ClassNotFoundException: kafka.perf.ProducerPerformance
>         at java.net.URLClassLoader$1.run(URLClassLoader.java:217)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at java.net.URLClassLoader.findClass(URLClassLoader.java:205)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:321)
>         at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:294)
>         at java.lang.ClassLoader.loadClass(ClassLoader.java:266)
> Could not find the main class: kafka.perf.ProducerPerformance. Program
> will exit.
>
> The command line generated by the script looks like this:
>
> java -Xmx512M -server -XX:+UseCompressedOops -XX:+UseParNewGC
> -XX:+UseConcMarkSweepGC -XX:+CMSClassUnloadingEnabled
> -XX:+CMSScavengeBeforeRemark -XX:+DisableExplicitGC
> -Djava.awt.headless=true -Dcom.sun.management.jmxremote
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dcom.sun.management.jmxremote.ssl=false
> -Dlog4j.configuration=file:/home/User/work/kafka_2.8.0-0.8.0/bin/../config/tools-log4j.properties
> -cp
> :/home/User/work/kafka_2.8.0-0.8.0/bin/../core/target/scala-2.8.0/*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../perf/target/scala-2.8.0/kafka*.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/jopt-simple-3.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/log4j-1.2.15.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-annotation-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/metrics-core-2.2.0.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-compiler.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/scala-library.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-api-1.7.2.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/slf4j-simple-1.6.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/snappy-java-1.0.4.1.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zkclient-0.3.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../libs/zookeeper-3.3.4.jar:/home/User/work/kafka_2.8.0-0.8.0/bin/../kafka_2.8.0-0.8.0.jar
> kafka.perf.ProducerPerformance
>
> I unzipped kafka_2.8.0-0.8.0.jar and verified that there is no perf
> subdirectory.
> Kafka deployment package was downloaded this morning from the official
> Apache mirror.
>
> How this problem can be solved?
>
> Thank you,
> Michael Popov
>
>