Comparison of kafka- node and node -rdkafka

Question

I would like to use Kafka with my Node.JS services as a message broker and debate between kafka-node and node-rdkafka .

I began to test the capabilities of kafka-node (the library seems to be much more popular) and was able to create a producer, write to Kafka with it, create a consumer and read with Kafka with it. However, I noticed that the library does not currently support some Kafka functions, such as timestamp recording and lz4 compression (functions that Scala drivers support).

Has anyone encountered these or other failures in kafka-node (or node -rdkafka) and decided to use a different library because of them?

Answer 1

Michal

I recently completed a comparison of two libraries. http://www.tivix.com/blog/nodejs-kafka-producers/ . You will find implementations for both customers. As a result, I found that rdkafka has lower processor utilization than node kafka. Moreover, it is supported by Blizzard, so I’m sure that they will gladly agree to any PR that you have provided.