Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka >> mail # user >> Response time degradation


Copy link to this message
-
Re: Response time degradation
Danny,

Please can you file a bug to explain the issue ?

Thanks,
Neha
On Mon, Jan 28, 2013 at 8:57 AM, Danny Yeshurun <[EMAIL PROTECTED]>wrote:

> No data on the second time. The partition is empty but starting from the
> second request the response is slow.
>
> On Mon, Jan 28, 2013 at 6:31 PM, Jun Rao <[EMAIL PROTECTED]> wrote:
>
> > Not sure what's the causing the slow down. Is the second fetch geting
> more
> > data?
> >
> > Also, if all those partitions are on the same broker, you could have
> > fetched all partitions' data in a single fetch request.
> >
> > Thanks,
> >
> > Jun
> >
> > On Mon, Jan 28, 2013 at 6:02 AM, Danny Yeshurun <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Hi,
> > >
> > > I am using Kafka 0.7.2
> > > I have a consumer that tries to fetch messages from several partitions
> on
> > > the same broker (and topic).
> > > The consumers issues a fetch request per partition, if there are
> messages
> > > to read, it fetches the first one and goes to the next partition to
> fetch
> > > another message and so on (in a loop).
> > > When there are not messages in a partition, the consumer will issue
> > another
> > > fetch request on the next cycle etc.
> > > I noticed that starting with the 2nd fetch request, response time
> becomes
> > > unacceptable, i.e. reading back the response from the broker takes
> ~0.04
> > > second (while it took ~0.0006 sec on the first time).
> > > This behavior is consistent over different runs.
> > >
> > > Any idea?
> > >
> > > Thanks,
> > > Danny
> > >
> >
>

 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB