Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Kafka, mail # user - Broker ID

Copy link to this message
Re: Broker ID
Chris Burroughs 2012-01-03, 20:12
On 12/09/2011 12:48 PM, Jay Kreps wrote:
> Yes, I don't think they need to be sequential though we always assign them
> sequentially at LinkedIn.

At Clearspring we found it convenient to uses the last octet of the IP
since that was already unique per cluster (no clusters span multiple
subnets [1]).  We have on occasion confused ourselves by having
non-sequential ids, but it's probably best that those bugs were squashed
sooner rather than latter.

[1] And yes, this will be a nifty problem when a cluster no longer fits
on a single subnet ;-)