Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - log.file.size limit?


Copy link to this message
-
Re: log.file.size limit?
Jay Kreps 2013-03-25, 23:28
We limit individual segment files to 2GB for slightly esoteric
reasons. There is no limit for the log as a whole so limiting the
segments to 2GB does not constrain how much data you can retain.

-Jay

On Mon, Mar 25, 2013 at 11:42 AM, S Ahmed <[EMAIL PROTECTED]> wrote:
> Is there any limit to how large a log file can be?
> I swear I read somewhere that java's memory mapped implementation is
> limited to 2GB but I'm not sure.