Capacity planning
Capacity planning is mostly required when you want to deploy Kafka in your production environment. Capacity planning helps you achieve the desired performance from Kafka systems along with the required hardware. In this section, we will talk about some of the important aspects to consider while performing capacity planning of Kafka cluster.
Note
Note that there is no one definite way to perform Kafka capacity planning. There are multiple factors that come into the picture, and they vary depending upon your organizational use cases.
Our goal here is to give you a good starting point for Kafka cluster capacity planning with some pointers that you should always keep in mind. Let's consider these one by one.
Capacity planning goals
This is the most important thing while performing capacity planning of your Kafka cluster. You should be very clear with your capacity planning goals. You should understand that without having clear goals in mind, it is very difficult to perform appropriate...