Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Consumer not consuming for 1st time


Copy link to this message
-
Re: Consumer not consuming for 1st time
That error means the consumer has never checkpointed any offset in ZK.

Thanks,

Jun
On Thu, Nov 21, 2013 at 10:31 PM, Tarang Dawer <[EMAIL PROTECTED]>wrote:

> Hi Jun
>
> I tried the ConsumerOffsetChecker script for checking the offsets
>
> but there also , got an exception , with no information regarding the
> offset. Although when i start the consumer for the second time, it consumed
> the data, but still same response from the offset checker script.
>
> Please find the debug- level trace of the console output below.
>
>
> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker \--group
> consumerGroup675437777 \--zkconnect 192.168.145.144:2181 \--topic
> test-topic;
> [2013-11-22 11:55:52,098] DEBUG Creating new ZookKeeper instance to connect
> to 192.168.145.144:2181. (org.I0Itec.zkclient.ZkConnection)
> [2013-11-22 11:55:52,098] INFO Starting ZkClient event thread.
> (org.I0Itec.zkclient.ZkEventThread)
> [2013-11-22 11:55:52,103] INFO Client
> environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:host.name
> =hadoop-namenode
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.version=1.6.0_33
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.vendor=Sun
> Microsystems Inc. (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:java.home=/usr/java/jdk1.6.0_33/jre
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
>
> environment:java.class.path=:bin/../core/target/scala-2.8.0/*.jar:bin/../perf/target/scala-2.8.0/kafka*.jar:bin/../libs/jopt-simple-3.2.jar:bin/../libs/log4j-1.2.15.jar:bin/../libs/metrics-annotation-2.2.0.jar:bin/../libs/metrics-core-2.2.0.jar:bin/../libs/scala-compiler.jar:bin/../libs/scala-library.jar:bin/../libs/slf4j-api-1.7.2.jar:bin/../libs/slf4j-simple-1.6.4.jar:bin/../libs/snappy-java-1.0.4.1.jar:bin/../libs/zkclient-0.3.jar:bin/../libs/zookeeper-3.3.4.jar:bin/../kafka_2.8.0-0.8.0-beta1.jar
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
>
> environment:java.library.path=/usr/java/jdk1.6.0_33/jre/lib/amd64/server:/usr/java/jdk1.6.0_33/jre/lib/amd64:/usr/java/jdk1.6.0_33/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.io.tmpdir=/tmp
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.compiler=<NA>
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:os.name=Linux
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:os.arch=amd64
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:os.version=2.6.32-279.el6.x86_64
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:user.name=impadmin
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:user.home=/home/impadmin
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:user.dir=/home/impadmin/Software/kafka_2.8.0-0.8.0-beta1
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,104] INFO Initiating client connection, connectString=
> 192.168.145.144:2181 sessionTimeout=30000
> watcher=org.I0Itec.zkclient.ZkClient@6825c828
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,105] DEBUG zookeeper.disableAutoWatchReset is false
> (org.apache.zookeeper.ClientCnxn)
> [2013-11-22 11:55:52,299] DEBUG Awaiting connection to Zookeeper server
> (org.I0Itec.zkclient.ZkClient)
> [2013-11-22 11:55:52,299] INFO Opening socket connection to server /
> 192.168.145.144:2181 (org.apache.zookeeper.ClientCnxn)
> [2013-11-22 11:55:52,299] DEBUG Waiting for keeper state SyncConnected
> (org.I0Itec.zkclient.ZkClient)
> [2013-11-22 11:55:52,370] INFO Socket connection established to