Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # dev - Re: Please clean your ZK and Kafka data if you check out 0.8 HEAD


Copy link to this message
-
Re: Please clean your ZK and Kafka data if you check out 0.8 HEAD
ben fleis 2013-02-27, 11:39
Hi Swapnil,

I have done exactly this (killed and wiped everything), and have found that
my custom formatter based ConsoleConsumer fails:

[2013-02-27 12:34:31,420] ERROR Error processing message, stopping
consumer:  (kafka.consumer.ConsoleConsumer$)
java.lang.NumberFormatException: For input string: ""192.168.2.132",
"jmx_port""
        at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
        at java.lang.Integer.parseInt(Integer.java:449)
        at java.lang.Integer.parseInt(Integer.java:499)
        at
scala.collection.immutable.StringLike$class.toInt(StringLike.scala:207)
        at scala.collection.immutable.StringOps.toInt(StringOps.scala:31)
        at kafka.cluster.Broker$.createBroker(Broker.scala:34)
        at
kafka.utils.ZkUtils$$anonfun$getCluster$1.apply(ZkUtils.scala:450)
        at
kafka.utils.ZkUtils$$anonfun$getCluster$1.apply(ZkUtils.scala:448)
        at scala.collection.Iterator$class.foreach(Iterator.scala:631)
        at
scala.collection.JavaConversions$JIteratorWrapper.foreach(JavaConversions.scala:474)
        at
scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
        at
scala.collection.JavaConversions$JListWrapper.foreach(JavaConversions.scala:521)
        at kafka.utils.ZkUtils$.getCluster(ZkUtils.scala:448)
        at
kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener$$anonfun$syncedRebalance$1.apply$mcVI$sp(ZookeeperConsumerConnector.scala:371)
        at
scala.collection.immutable.Range$ByOne$class.foreach$mVc$sp(Range.scala:282)
        at
scala.collection.immutable.Range$$anon$2.foreach$mVc$sp(Range.scala:265)
        at
kafka.consumer.ZookeeperConsumerConnector$ZKRebalancerListener.syncedRebalance(ZookeeperConsumerConnector.scala:368)
        at
kafka.consumer.ZookeeperConsumerConnector.kafka$consumer$ZookeeperConsumerConnector$$reinitializeConsumer(ZookeeperConsumerConnector.scala:697)
        at
kafka.consumer.ZookeeperConsumerConnector$WildcardStreamsHandler.<init>(ZookeeperConsumerConnector.scala:732)
        at
kafka.consumer.ZookeeperConsumerConnector.createMessageStreamsByFilter(ZookeeperConsumerConnector.scala:141)
        at kafka.consumer.ConsoleConsumer$.main(ConsoleConsumer.scala:183)
        at kafka.consumer.ConsoleConsumer.main(ConsoleConsumer.scala)

I haven't tracked down why the mismatch only occurs with my formatter, but
advice is appreciated.

ben