Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Question on Kafka partitions.


Copy link to this message
-
Re: Question on Kafka partitions.
This indicates the controller (see the end of
http://kafka.apache.org/documentation.html#replication) of the cluster.

Thanks,

Jun
On Thu, Sep 12, 2013 at 5:29 PM, Lu Xuechao <[EMAIL PROTECTED]> wrote:

> Thanks Rao. I found both log.dir and log.dirs worked.
>
> When I start up all my brokers, I see below log message on the console of
> broker 1: What does that mean? Partition leader or not?
>
> [2013-09-12 13:10:54,570] INFO New leader is 1
> (kafka.server.ZookeeperLeaderElector$LeaderChangeListener)
>
>
> On Thu, Sep 12, 2013 at 1:15 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > 1. You can put multiple directories, each on a separate volume, in
> > log.dirs.
> >
> > 2. Yes, our replica assignment logic will try to spread the partitions
> and
> > the leaders evenly among the brokers.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Wed, Sep 11, 2013 at 9:59 PM, Lu Xuechao <[EMAIL PROTECTED]> wrote:
> >
> > > Hi Team,
> > >
> > > I have some questions regarding Kafka partitions:
> > >
> > > 1. Based on my understanding, the partitions of the same broker have
> > > contention on disk IO. Say If I have 10 hard drives, can I specify all
> > the
> > > partitions spread evenly on those drives?
> > >
> > > 2. If I configure default.replication.factor=2, then for each partition
> > > there will be one leader and one follower, right? Say if I have 10
> nodes
> > > with a broker on each node, I want to partition 10 way then can each of
> > the
> > > 10 broker instances be a leader for 1 partition and a follower for 1 or
> > > more partitions based on the replication factor?
> > >
> > > thanks,
> > >
> >
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB