-[GitHub] kafka pull request: KAFKA-1414: Speedup broker startup after hard ...
GitHub user ataraxer opened a pull request:
KAFKA-1414: Speedup broker startup after hard reset and shutdown
This patch increases speed of both hard reset and shutdown by introducing `log.recovery.threads` and `log.shutdown.threads` properties, which allows to perform work required for them in parallel, grained by log directories.
Best performance can be achieved by setting thread count to number of log directories, provided that they are located on dedicated drives. Although that option should be used with caution due to the possibility of native JVM out of memory error.
Patch is compiled of changes proposed by Jay Kreps, Alexey Ozeritskiy, Dmitry Bugaychenko by Anton Karamanov.
All tests are passing.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ataraxer/kafka kafka-1414
Alternatively you can review and apply these changes as the patch at:
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #26
Author: Anton Karamanov <[EMAIL PROTECTED]>
KAFKA-1414 Speedup broker startup after hard reset and shutdown; patched by Jay Kreps, Alexey Ozeritskiy, Dmitry Bugaychenko and Anton Karamanov
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [EMAIL PROTECTED] or file a JIRA ticket