| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
19 (0.92s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Question about Partitions not receive equal number messages - Kafka - [mail # user]
|
|
...Hi Neha,We can not understand why the partitions will be unbalanced if each threadgets different number of messages.We go through the code of producer, and the partition number is generatedb...
|
|
|
Author: 王国栋,
2013-04-17, 14:48
|
|
|
Re: no logs received when a broker restart after clearing its logs - Kafka - [mail # user]
|
|
...Thanks Neha.Yes, I believe we run into this issue.We will try this patch. Currently, make topic-partition directory manuallyis OK for us.GuodongOn Wed, Apr 17, 2013 at 9:24 PM, Neha Na...
|
|
|
Author: 王国栋,
2013-04-17, 14:41
|
|
|
Re: Kafka throw InvalidMessageException and lost data - Kafka - [mail # user]
|
|
...Hi Neha,I am sorry, we couldn't find the detail reason of this bug. But we dobelieve that the bug is in java.nio package. Something bad may happenduring sync-producer sends data in byteBuffe...
|
|
|
Author: 王国栋,
2013-03-25, 04:23
|
|
|
Re: Kafka throw InvalidMessageException and lost data - Kafka - [mail # user]
|
|
...Hi Neha & Jun,I think we have found the reason of this bug.It is related to jdk versions. In the beginning, we use jdk1.6.20 to runthe test.Yesterday, we used jdk1.6.38. Everything is OK now...
|
|
|
Author: 王国栋,
2013-03-25, 03:58
|
|
|
Re: Kafka throw InvalidMessageException and lost data - Kafka - [mail # user]
|
|
...Hi Jun,We use one thread with one sync produce to send data to broker(QPS:10k-15k, each log is about 1k bytes). The problem is reproduced.We have used Producer and SyncProducer in our test. ...
|
|
|
Author: 王国栋,
2013-03-21, 04:43
|
|
|
Re: Kafka throw InvalidMessageException and lost data - Kafka - [mail # user]
|
|
...Hi Neha,Our test is reproducible. We use a log replay tool to send the same part oflog to kafka.We will check the log file latter and try to find some more hints.Till now, it seems that if t...
|
|
|
Author: 王国栋,
2013-03-20, 07:34
|
|
|
Re: Kafka throw InvalidMessageException and lost data - Kafka - [mail # user]
|
|
...Hi Jun,we do not use any compression in our test.We deploy producer and broker in the same machine. The problem stillexists. We use sync producer, and send one message at a time(no batch now...
|
|
|
Author: 王国栋,
2013-03-20, 07:29
|
|
|
Re: how to configure zk.connect in 0.7.2 - Kafka - [mail # user]
|
|
...Thanks Jun. It works~On Wed, Mar 13, 2013 at 1:14 AM, Jun Rao wrote:> You should set it to the following, with namespace only specified at the> end:> zk8sh.prod.mediav.com:219...
|
|
|
Author: 王国栋,
2013-03-13, 03:21
|
|
|
Re: Graceful termination of kafka broker after draining all the data consumed - Kafka - [mail # user]
|
|
...Thanks Jun. I will check more info about 0.8On Tue, Feb 19, 2013 at 12:51 AM, Jun Rao wrote:> In 0.7, it's not very easy to decommission a broker using ZK based> producers. It's ...
|
|
|
Author: 王国栋,
2013-02-19, 01:41
|
|
|
Re: Graceful termination of kafka broker after draining all the data consumed - Kafka - [mail # user]
|
|
...Hi Jun,If we use high level producer based on zookeeper, how can we decommission abroker without message loss?Since we want to partition the log with IP, if all the brokers use thesame...
|
|
|
Author: 王国栋,
2013-02-17, 10:20
|
|
|
|
