For anyone wanting to play with the settings for kafka this post helped a lot Restrict Kafka disk usage
I found it easier editing the .env
file rather than the docker-compose.yml
file.
I added the following lines to my .env
file
KAFKA_LOG_RETENTION_HOURS=24
KAFKA_LOG_RETENTION_BYTES=53687091200
KAFKA_LOG_SEGMENT_BYTES=1073741824
KAFKA_LOG_RETENTION_CHECK_INTERVAL_MS=300000
KAFKA_LOG_SEGMENT_DELETE_DELAY_MS=60000