Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Reply:Bad user experience when out of box


Copy link to this message
-
Re: Reply:Bad user experience when out of box
Joe Stein 2012-02-07, 10:42
SuoNayi,

Do you have the Kafka Server running?   The Producer will need to find a
Broker that is registered within ZK for it to publish messages.

So like in the Quick Start this is still a required step

*bin/kafka-server-start.sh config/server.properties*
On Tue, Feb 7, 2012 at 5:00 AM, SuoNayi <[EMAIL PROTECTED]> wrote:

> Sorry for that I have found that hostname of the test server is of
> misconfigure.
> Here is new question when I send messages with 20 producers that each
> workes in it's own thread,
>
> My client throws exception of timeout:
> Exception in thread "Thread-2" java.net.ConnectException: Connection timed
> out: connect
> at sun.nio.ch.Net.connect(Native Method)
> at sun.nio.ch.SocketChannelImpl.connect(Unknown Source)
> at kafka.producer.SyncProducer.connect(SyncProducer.scala:172)
> at kafka.producer.SyncProducer.send(SyncProducer.scala:101)
> at kafka.producer.SyncProducer.send(SyncProducer.scala:117)
> at
> kafka.producer.ProducerPool$$anonfun$send$1.apply$mcVI$sp(ProducerPool.scala:116)
> at
> kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:102)
> at
> kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:102)
> at
> scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:57)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
> at kafka.producer.ProducerPool.send(ProducerPool.scala:102)
> at kafka.producer.Producer.configSend(Producer.scala:167)
> at kafka.producer.Producer.send(Producer.scala:106)
> at kafka.javaapi.producer.Producer.send(Producer.scala:104)
> at test.kafka.TestOutboundKfa$Sender.run(TestOutboundKfa.java:87)
>
> At 2012-02-07 10:26:43,SuoNayi <[EMAIL PROTECTED]> wrote:
> >Hi all,
> >   I'm new to kafka.I set up zooker server and kafka server on my test
> server by following the quickstart.
> >   I also success running the example list in the quickstart,such as step
> 3 and step 4.
> >   Now I set up a project on my pc to run examples of directory named
> kafka-0.7.0-incubating-src\examples.
> >   Of course, I changed addresses  and ports of zk server and kafka that
> both pointed at my test server.
> >   When start the main function of class KafkaConsumerProducerDemo,it
> throws the following exception:
> >Exception in thread "main"
> org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to
> zookeeper server within timeout: 6000
> >at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:876)
> >at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:98)
> >at org.I0Itec.zkclient.ZkClient.<init>(ZkClient.java:84)
> >at
> kafka.producer.ZKBrokerPartitionInfo.<init>(ZKBrokerPartitionInfo.scala:63)
> >at kafka.producer.Producer.<init>(Producer.scala:53)
> >at kafka.javaapi.producer.Producer.<init>(Producer.scala:33)
> >at kafka.javaapi.producer.Producer.<init>(Producer.scala:40)
> >at kafka.examples.Producer.<init>(Producer.java:35)
> >at
> kafka.examples.KafkaConsumerProducerDemo.main(KafkaConsumerProducerDemo.java:23)
> >   I have to specify the timeout value for zk,like this,
> zk.connectiontimeout.ms=10000 and the client could connect to zk server
> successfully.
> >   But another new exception is thrown again:
> >Exception in thread "Thread-0" java.nio.channels.ClosedChannelException
> >at sun.nio.ch.SocketChannelImpl.ensureWriteOpen(Unknown Source)
> >at sun.nio.ch.SocketChannelImpl.write(Unknown Source)
> >at
> kafka.network.BoundedByteBufferSend.writeTo(BoundedByteBufferSend.scala:48)
> >at kafka.network.Send$class.writeCompletely(Transmission.scala:76)
> >at
> kafka.network.BoundedByteBufferSend.writeCompletely(BoundedByteBufferSend.scala:25)
> >at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:88)
> >at kafka.producer.SyncProducer.send(SyncProducer.scala:87)
> >at kafka.producer.SyncProducer.send(SyncProducer.scala:117)
> >at
> kafka.producer.ProducerPool$$anonfun$send$1.apply$mcVI$sp(ProducerPool.scala:116)
> >at
> kafka.producer.ProducerPool$$anonfun$send$1.apply(ProducerPool.scala:102)
/*
Joe Stein
http://www.linkedin.com/in/charmalloc
Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop>
*/