Posts

Showing posts with the label kafka-topic

Kafka not getting rid of data when setting retention.ms

Image
Clash Royale CLAN TAG #URR8PPP Kafka not getting rid of data when setting retention.ms So when I look for a way to count the messages in a topic, this one is good kafka-run-class kafka.tools.GetOffsetShell --broker-list broker1:9092,broker2:9092,broker3:9092 --topic rev-dly-upd --time -1 kafka-run-class kafka.tools.GetOffsetShell --broker-list broker1:9092,broker2:9092,broker3:9092 --topic rev-dly-upd --time -1 The only thing is, when I change the retention.ms config to retention.ms=1000 , and even check that the topic has been configured by running kafka-topics --describe --zookeeper zookeeper1:2181 --topic rev-dly-upd . I can see clearly that that config is set at 1000... retention.ms retention.ms=1000 kafka-topics --describe --zookeeper zookeeper1:2181 --topic rev-dly-upd Topic:rev-dly-upd PartitionCount:8 ReplicationFactor:3 Configs:retention.ms=1000 Topic: rev-dly-upd Partition: 0 Leader: 159 Replicas: 159,96,160 Isr: 159,96,160 Topic: rev-dly-upd Partitio...