Capacity planning for kafka
We are capacity planning for kafka deployment (Replication factor 3) in
production environment, the producer is producing data at 1.5Gbps. Total
number of producers will be around 500 and there will be 100 consumers. How
many cores would be required to support them? And are there any known
repercussions of running kafka brokers along with other processor intensive
processes. Disks will still be separate for kafka and other processes.
We are also trying to decide between SSDs and HDDs. Are there any knows
production deployment of kafka over SSDs?