Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Consumer not consuming for 1st time


Copy link to this message
-
Re: Consumer not consuming for 1st time
That error means the consumer has never checkpointed any offset in ZK.

Thanks,

Jun
On Thu, Nov 21, 2013 at 10:31 PM, Tarang Dawer <[EMAIL PROTECTED]>wrote:

> Hi Jun
>
> I tried the ConsumerOffsetChecker script for checking the offsets
>
> but there also , got an exception , with no information regarding the
> offset. Although when i start the consumer for the second time, it consumed
> the data, but still same response from the offset checker script.
>
> Please find the debug- level trace of the console output below.
>
>
> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker \--group
> consumerGroup675437777 \--zkconnect 192.168.145.144:2181 \--topic
> test-topic;
> [2013-11-22 11:55:52,098] DEBUG Creating new ZookKeeper instance to connect
> to 192.168.145.144:2181. (org.I0Itec.zkclient.ZkConnection)
> [2013-11-22 11:55:52,098] INFO Starting ZkClient event thread.
> (org.I0Itec.zkclient.ZkEventThread)
> [2013-11-22 11:55:52,103] INFO Client
> environment:zookeeper.version=3.3.3-1203054, built on 11/17/2011 05:47 GMT
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:host.name
> =hadoop-namenode
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.version=1.6.0_33
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.vendor=Sun
> Microsystems Inc. (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:java.home=/usr/java/jdk1.6.0_33/jre
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
>
> environment:java.class.path=:bin/../core/target/scala-2.8.0/*.jar:bin/../perf/target/scala-2.8.0/kafka*.jar:bin/../libs/jopt-simple-3.2.jar:bin/../libs/log4j-1.2.15.jar:bin/../libs/metrics-annotation-2.2.0.jar:bin/../libs/metrics-core-2.2.0.jar:bin/../libs/scala-compiler.jar:bin/../libs/scala-library.jar:bin/../libs/slf4j-api-1.7.2.jar:bin/../libs/slf4j-simple-1.6.4.jar:bin/../libs/snappy-java-1.0.4.1.jar:bin/../libs/zkclient-0.3.jar:bin/../libs/zookeeper-3.3.4.jar:bin/../kafka_2.8.0-0.8.0-beta1.jar
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
>
> environment:java.library.path=/usr/java/jdk1.6.0_33/jre/lib/amd64/server:/usr/java/jdk1.6.0_33/jre/lib/amd64:/usr/java/jdk1.6.0_33/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.io.tmpdir=/tmp
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:java.compiler=<NA>
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:os.name=Linux
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:os.arch=amd64
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:os.version=2.6.32-279.el6.x86_64
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:user.name=impadmin
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client environment:user.home=/home/impadmin
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,103] INFO Client
> environment:user.dir=/home/impadmin/Software/kafka_2.8.0-0.8.0-beta1
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,104] INFO Initiating client connection, connectString=
> 192.168.145.144:2181 sessionTimeout=30000
> watcher=org.I0Itec.zkclient.ZkClient@6825c828
> (org.apache.zookeeper.ZooKeeper)
> [2013-11-22 11:55:52,105] DEBUG zookeeper.disableAutoWatchReset is false
> (org.apache.zookeeper.ClientCnxn)
> [2013-11-22 11:55:52,299] DEBUG Awaiting connection to Zookeeper server
> (org.I0Itec.zkclient.ZkClient)
> [2013-11-22 11:55:52,299] INFO Opening socket connection to server /
> 192.168.145.144:2181 (org.apache.zookeeper.ClientCnxn)
> [2013-11-22 11:55:52,299] DEBUG Waiting for keeper state SyncConnected
> (org.I0Itec.zkclient.ZkClient)
> [2013-11-22 11:55:52,370] INFO Socket connection established to

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB