Sentry-ingest-consumer crashinglooping

1

I am running sentry on GKE.
Helm chart version: 11.5.0
App Version: 21.7.0

I am seeing the below error after deploying sentry.

14:47:51 [INFO] sentry.plugins.github: apps-not-configured
Traceback (most recent call last):
  File "/usr/local/bin/sentry", line 8, in <module>
    sys.exit(main())
  File "/usr/local/lib/python3.6/site-packages/sentry/runner/__init__.py", line 196, in main
    func(**kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 69, in inner
    return ctx.invoke(f, *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/decorators.py", line 21, in new_func
    return f(get_current_context(), *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py", line 29, in inner
    return ctx.invoke(f, *args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py", line 506, in ingest_consumer
    get_ingest_consumer(consumer_types=consumer_types, executor=executor, **options).run()
  File "/usr/local/lib/python3.6/site-packages/sentry/ingest/ingest_consumer.py", line 423, in get_ingest_consumer
    topic_names=topic_names, worker=IngestConsumerWorker(executor), **options
  File "/usr/local/lib/python3.6/site-packages/sentry/utils/kafka.py", line 86, in create_batching_kafka_consumer
    **options,
  File "/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py", line 186, in __init__
    queued_min_messages,
  File "/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py", line 231, in create_consumer
    wait_for_topics(admin_client, topics)
  File "/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py", line 56, in wait_for_topics
    % (topic, topic_metadata.error)
RuntimeError: Unknown error when waiting for Kafka topic 'ingest-transactions': KafkaError{code=INVALID_REPLICATION_FACTOR,val=38,str="Broker: Invalid replication factor"}

thanks in advance for any support.

2

like someone said, the devil is in the details.

i honestly raised this topic only because i was lazy to read through the code. Since I was not getting any response, i decided to read through the code. Turns out, the default replication value was set to 3 and i had only one replica to save some resources. Playing around with the numbers fixed the issue.

thanks for the motivation folks…