Is there any simulator / tool for generating messages for streaming?

Question

For testing purposes, I need to simulate a client to generate 100,000 messages per second and send them to the kafka theme. Is there any tool or method that can help me generate these random messages?

Answer 1

There is a built-in tool for creating a dummy load located at bin/kafka-producer-perf-test.sh( https://github.com/apache/kafka/blob/trunk/bin/kafka-producer-perf-test.sh ). You can refer to https://github.com/apache/kafka/blob/trunk/tools/src/main/java/org/apache/kafka/tools/ProducerPerformance.java#L106 to find out how to use it.

One use case would be:

bin/kafka-producer-perf-test.sh --broker-list localhost:9092 --messages 10000000 --topic test --threads 10 --message-size 100 --batch-size 10000 --throughput 100000

A key point is the flag --throughput 100000, which indicates that "the maximum throttle message volume is about 100,000 messages per second"

Answer 2

https://github.com/josephadler/eventsim, "" (, , : -P):

Eventsim - , . Scala, ( ). - ( - Spotify); , . , : . Apache Kafka.

, , , , . , , , , , , .