Migrated from v9 to v10 recently. Now, the Docker volume
sentry-kafka was consuming 107G within just 4 days of operation. Is there a possibility to restrict it? This might be related to How to disable Kafka logs in on premise sentry
I’ve found this great article about limiting Kafka: http://iv-m.github.io/articles/kafka-limit-disk-space/
It suggests to add:
"log.retention.hours": 24, "log.retention.bytes": 1073741824, "log.segment.bytes": 107374182, "log.retention.check.interval.ms": 20000, "log.segment.delete.delay.ms": 1000
However, where would I apply this to? I’ve tried
sentry/sentry.conf.py, but its Kafka options are only for the producer end.
What options would make sense in terms of Sentry? Does it only temporarily store incoming requests before they are processed or is Kafka also used as permanent storage?
Even if I’d loose some events, I’m in favor of keeping this volume small.