Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Kafka, mail # user - log.file.size limit?


+
S Ahmed 2013-03-25, 18:52
+
David Arthur 2013-03-25, 19:14
+
S Ahmed 2013-03-25, 20:38
+
David Arthur 2013-03-25, 23:21
Copy link to this message
-
Re: log.file.size limit?
Jay Kreps 2013-03-25, 23:28
We limit individual segment files to 2GB for slightly esoteric
reasons. There is no limit for the log as a whole so limiting the
segments to 2GB does not constrain how much data you can retain.

-Jay

On Mon, Mar 25, 2013 at 11:42 AM, S Ahmed <[EMAIL PROTECTED]> wrote:
> Is there any limit to how large a log file can be?
> I swear I read somewhere that java's memory mapped implementation is
> limited to 2GB but I'm not sure.