I am using kafka 0.8.1.1. I have a 3 node kafka cluster with some themes having about 5 sections. I planned to increase the number of nodes to 5 in the cluster and move some sections from existing topics to new brokers.
Previous partition state: broker1 : topic1 { partition 0 } broker2 : topic1 { partition 1,2} broker3 : topic1 { partition 3,4} New intended state: broker1 : topic1 { partition 0} broker2 : topic1 { partition 1} broker3 : topic1 { partition 3} broker4 : topic1 { partition 4} broker5 : topic1 { partition 2} command which I used: bin/kafka-reassign-partitions.sh --reassignment-json-file partitions-to-move.json --zookeeper zkserver1:2181,zkserver2:2181,zkserver3:2181 --execute partitions-to-move.json { "partitions":[{"topic": "topic1","partition": 4,"replicas": [4] }], "version":1 }
The error messages I see are:
[2015-12-22 11:19:46,447] WARN [KafkaApi-2] Produce request with correlation id 2462842 from client kafka-node-client on partition [topic1,4] failed due to Partition [topic1,4] doesn't exist on 3 (kafka.server.KafkaApis)
I really searched, but did not find any suitable answers. Evaluate any guidance / help to figure it out.
source share