Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka >> mail # user >> log.file.size limit?

S Ahmed 2013-03-25, 18:52
David Arthur 2013-03-25, 19:14
S Ahmed 2013-03-25, 20:38
David Arthur 2013-03-25, 23:21
Copy link to this message
Re: log.file.size limit?
We limit individual segment files to 2GB for slightly esoteric
reasons. There is no limit for the log as a whole so limiting the
segments to 2GB does not constrain how much data you can retain.


On Mon, Mar 25, 2013 at 11:42 AM, S Ahmed <[EMAIL PROTECTED]> wrote:
> Is there any limit to how large a log file can be?
> I swear I read somewhere that java's memory mapped implementation is
> limited to 2GB but I'm not sure.