Make a permanent journal entry in Kafka magazine

I am writing magazine posts on the topic of Kafka, and I want this topic to remain constant. I saw in Kafka and Kafka Connect (_schemas, connect-configs, connect-status, connect-offsets, etc.) that there are special topics that are not deleted by the log storage time. How to include a theme that will be similar to these other special topics? Is this a naming convention or some other properties?

thank

+4
source share
2 answers

These special topics are concise topics. This means that they consist of key messages and retain only the last list. Full entry here . This is probably what you want for an infinite retention time in most cases.

+2
source

If you want to keep all topics forever, you can set both log.retention.hoursand log.retention.bytes-1.

+6
source

Source: https://habr.com/ru/post/1656014/


All Articles