The optimal number of sections for a kafka theme for 5 brokers with a replication coefficient = 3 in 1 cluster

Question

Which is optimally not. section for a topic that has 5 brokers and a replication rate = 3? There are only 6 topics in this cluster.

The configuration of the machine on which each broker works is as follows.

Memory=16gb
Porcessor= Octacore, Intel(R) Xeon(R) CPU E5-2650 v3 @ 2.30GHz

Any problems besides an open file with 1000 sections per topic?

Answer 1

Starting with Kafka 1.1.0, it is recommended to have up to 4,000 sections per broker and up to 200,000 sections per cluster. Find out more here .