Kafka, mail # user - Re: java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33 - 2014-01-01, 17:47
Solr & Elasticsearch trainings in New York & San Francisco [more info][hide]
 Search Hadoop and all its subprojects:

Switch to Threaded View
Copy link to this message
-
Re: java.lang.IllegalArgumentException Buffer.limit on FetchResponse.scala + 33
In our wire protocol, we expect the first 4 bytes for a response to be its
size. If the actual size is larger than 2GB, what's stored in the those 4
bytes is the overflowed value. This could cause some of the buffer size to
be smaller than it should be later on. If #partitions * fetch_size  is
larger than 2GB in a single fetch request, you could hit this problem. You
can try reducing the fetch size. Ideally, the sender should catch this and
throw an exception, which we don't do currently.

Thanks,

Jun
On Wed, Jan 1, 2014 at 9:27 AM, Gerrit Jansen van Vuuren <
[EMAIL PROTECTED]> wrote:
 
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB