kafka_1 | [2021-03-09 05:42:59,164] INFO [/config/changes-event-process-thread]: Starting (kafka.common.ZkNodeChangeNotificationListener$ChangeEventProcessThread)
kafka_1 | [2021-03-09 05:42:59,329] INFO [SocketServer brokerId=1001] Started data-plane processors for 1 acceptors (kafka.network.SocketServer)
kafka_1 | [2021-03-09 05:42:59,714] INFO Creating topic transactions-subscription-results with configuration {} and initial partition assignment Map(0 → ArrayBuffer(1001)) (kafka.zk.AdminZkClient)
ingest-consumer_1 | 05:42:59 [WARNING] batching-kafka-consumer: Topic ‘ingest-events’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:42:59 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-events_1 | 05:42:59 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
ingest-consumer_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘ingest-events’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
ingest-consumer_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘ingest-events’ or its partitions are not ready, retrying…
subscription-consumer-events_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-events_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
snuba-replacer_1 | 2021-03-09 05:43:00,314 Caught ConsumerError(‘KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}’), shutting down…
post-process-forwarder_1 | * Unknown config option found: ‘slack.legacy-app’
snuba-consumer_1 | 2021-03-09 05:43:00,391 Caught ConsumerError(‘KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}’), shutting down…
snuba-replacer_1 | Traceback (most recent call last):
snuba-replacer_1 | File “/usr/local/bin/snuba”, line 33, in
snuba-replacer_1 | sys.exit(load_entry_point(‘snuba’, ‘console_scripts’, ‘snuba’)())
snuba-replacer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 829, in call
snuba-replacer_1 | return self.main(*args, **kwargs)
snuba-replacer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 782, in main
snuba-replacer_1 | rv = self.invoke(ctx)
snuba-replacer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1259, in invoke
snuba-replacer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-replacer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1066, in invoke
snuba-replacer_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-replacer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 610, in invoke
snuba-replacer_1 | return callback(*args, **kwargs)
snuba-replacer_1 | File “/usr/src/snuba/snuba/cli/replacer.py”, line 133, in replacer
snuba-replacer_1 | replacer.run()
snuba-replacer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 112, in run
snuba-replacer_1 | self._run_once()
snuba-replacer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 142, in _run_once
snuba-replacer_1 | self.__message = self.__consumer.poll(timeout=1.0)
snuba-replacer_1 | File “/usr/src/snuba/snuba/utils/streams/backends/kafka.py”, line 404, in poll
snuba-replacer_1 | raise ConsumerError(str(error))
snuba-replacer_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
snuba-consumer_1 | Traceback (most recent call last):
snuba-consumer_1 | File “/usr/local/bin/snuba”, line 33, in
snuba-consumer_1 | sys.exit(load_entry_point(‘snuba’, ‘console_scripts’, ‘snuba’)())
snuba-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 829, in call
snuba-consumer_1 | return self.main(*args, **kwargs)
snuba-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 782, in main
snuba-consumer_1 | rv = self.invoke(ctx)
snuba-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1259, in invoke
snuba-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1066, in invoke
snuba-consumer_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 610, in invoke
snuba-consumer_1 | return callback(*args, **kwargs)
snuba-consumer_1 | File “/usr/src/snuba/snuba/cli/consumer.py”, line 161, in consumer
snuba-consumer_1 | consumer.run()
snuba-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 112, in run
snuba-consumer_1 | self._run_once()
snuba-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 142, in _run_once
snuba-consumer_1 | self.__message = self.__consumer.poll(timeout=1.0)
snuba-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/backends/kafka.py”, line 767, in poll
snuba-consumer_1 | return super().poll(timeout)
snuba-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/backends/kafka.py”, line 404, in poll
snuba-consumer_1 | raise ConsumerError(str(error))
snuba-consumer_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
post-process-forwarder_1 | Traceback (most recent call last):
post-process-forwarder_1 | File “/usr/local/bin/sentry”, line 8, in
post-process-forwarder_1 | sys.exit(main())
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/init.py”, line 164, in main
post-process-forwarder_1 | cli(prog_name=get_prog(), obj={}, max_content_width=100)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 829, in call
post-process-forwarder_1 | return self.main(*args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 782, in main
post-process-forwarder_1 | rv = self.invoke(ctx)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1259, in invoke
post-process-forwarder_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1259, in invoke
post-process-forwarder_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1066, in invoke
post-process-forwarder_1 | return ctx.invoke(self.callback, **ctx.params)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
post-process-forwarder_1 | return callback(*args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/decorators.py”, line 21, in new_func
post-process-forwarder_1 | return f(get_current_context(), *args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py”, line 66, in inner
post-process-forwarder_1 | return ctx.invoke(f, *args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
post-process-forwarder_1 | return callback(*args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/decorators.py”, line 21, in new_func
post-process-forwarder_1 | return f(get_current_context(), *args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py”, line 28, in inner
post-process-forwarder_1 | return ctx.invoke(f, *args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
post-process-forwarder_1 | return callback(*args, **kwargs)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py”, line 333, in post_process_forwarder
post-process-forwarder_1 | initial_offset_reset=options[“initial_offset_reset”],
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/utils/services.py”, line 102, in
post-process-forwarder_1 | context[key] = (lambda f: lambda *a, **k: getattr(self, f)(*a, **k))(key)
post-process-forwarder_1 | File “/usr/local/lib/python3.6/site-packages/sentry/eventstream/kafka/backend.py”, line 204, in run_post_process_forwarder
post-process-forwarder_1 | raise Exception(error)
post-process-forwarder_1 | Exception: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
snuba-outcomes-consumer_1 | 2021-03-09 05:43:00,443 Caught ConsumerError(‘KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}’), shutting down…
snuba-outcomes-consumer_1 | Traceback (most recent call last):
snuba-outcomes-consumer_1 | File “/usr/local/bin/snuba”, line 33, in
snuba-outcomes-consumer_1 | sys.exit(load_entry_point(‘snuba’, ‘console_scripts’, ‘snuba’)())
snuba-outcomes-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 829, in call
snuba-outcomes-consumer_1 | return self.main(*args, **kwargs)
snuba-outcomes-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 782, in main
snuba-outcomes-consumer_1 | rv = self.invoke(ctx)
snuba-outcomes-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1259, in invoke
snuba-outcomes-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-outcomes-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1066, in invoke
snuba-outcomes-consumer_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-outcomes-consumer_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 610, in invoke
snuba-outcomes-consumer_1 | return callback(*args, **kwargs)
snuba-outcomes-consumer_1 | File “/usr/src/snuba/snuba/cli/consumer.py”, line 161, in consumer
snuba-outcomes-consumer_1 | consumer.run()
snuba-outcomes-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 112, in run
snuba-outcomes-consumer_1 | self._run_once()
snuba-outcomes-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/processing/processor.py”, line 142, in _run_once
snuba-outcomes-consumer_1 | self.__message = self.__consumer.poll(timeout=1.0)
snuba-outcomes-consumer_1 | File “/usr/src/snuba/snuba/utils/streams/backends/kafka.py”, line 404, in poll
snuba-outcomes-consumer_1 | raise ConsumerError(str(error))
snuba-outcomes-consumer_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-events_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
ingest-consumer_1 | * Unknown config option found: ‘slack.legacy-app’
ingest-consumer_1 | /usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py:51: DeprecationWarning: The ‘warn’ method is deprecated, use ‘warning’ instead
ingest-consumer_1 | logger.warn(“Topic ‘%s’ or its partitions are not ready, retrying…”, topic)
snuba-subscription-consumer-events_1 | Traceback (most recent call last):
snuba-subscription-consumer-events_1 | File “/usr/local/bin/snuba”, line 33, in
snuba-subscription-consumer-events_1 | sys.exit(load_entry_point(‘snuba’, ‘console_scripts’, ‘snuba’)())
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 829, in call
snuba-subscription-consumer-events_1 | return self.main(*args, **kwargs)
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 782, in main
snuba-subscription-consumer-events_1 | rv = self.invoke(ctx)
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1259, in invoke
snuba-subscription-consumer-events_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 1066, in invoke
snuba-subscription-consumer-events_1 | return ctx.invoke(self.callback, **ctx.params)
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/site-packages/click/core.py”, line 610, in invoke
snuba-subscription-consumer-events_1 | return callback(*args, **kwargs)
snuba-subscription-consumer-events_1 | File “/usr/src/snuba/snuba/cli/subscriptions.py”, line 138, in subscriptions
snuba-subscription-consumer-events_1 | SynchronizedConsumer(
snuba-subscription-consumer-events_1 | File “/usr/src/snuba/snuba/utils/streams/synchronized.py”, line 106, in init
snuba-subscription-consumer-events_1 | self.__commit_log_worker.result()
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/concurrent/futures/_base.py”, line 432, in result
snuba-subscription-consumer-events_1 | return self.__get_result()
snuba-subscription-consumer-events_1 | File “/usr/local/lib/python3.8/concurrent/futures/_base.py”, line 388, in __get_result
snuba-subscription-consumer-events_1 | raise self._exception
snuba-subscription-consumer-events_1 | File “/usr/src/snuba/snuba/utils/concurrent.py”, line 33, in run
snuba-subscription-consumer-events_1 | result = function()
snuba-subscription-consumer-events_1 | File “/usr/src/snuba/snuba/utils/streams/synchronized.py”, line 130, in __run_commit_log_worker
snuba-subscription-consumer-events_1 | message = self.__commit_log_consumer.poll(0.1)
snuba-subscription-consumer-events_1 | File “/usr/src/snuba/snuba/utils/streams/backends/kafka.py”, line 404, in poll
snuba-subscription-consumer-events_1 | raise ConsumerError(str(error))
snuba-subscription-consumer-events_1 | snuba.utils.streams.backends.abstract.ConsumerError: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
subscription-consumer-events_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
ingest-consumer_1 | Traceback (most recent call last):
ingest-consumer_1 | File “/usr/local/bin/sentry”, line 8, in
ingest-consumer_1 | sys.exit(main())
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/init.py”, line 164, in main
ingest-consumer_1 | cli(prog_name=get_prog(), obj={}, max_content_width=100)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 829, in call
ingest-consumer_1 | return self.main(*args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 782, in main
ingest-consumer_1 | rv = self.invoke(ctx)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1259, in invoke
ingest-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1259, in invoke
ingest-consumer_1 | return _process_result(sub_ctx.command.invoke(sub_ctx))
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 1066, in invoke
ingest-consumer_1 | return ctx.invoke(self.callback, **ctx.params)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/decorators.py”, line 21, in new_func
ingest-consumer_1 | return f(get_current_context(), *args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py”, line 66, in inner
ingest-consumer_1 | return ctx.invoke(f, *args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/decorators.py”, line 21, in new_func
ingest-consumer_1 | return f(get_current_context(), *args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/decorators.py”, line 28, in inner
ingest-consumer_1 | return ctx.invoke(f, *args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/click/core.py”, line 610, in invoke
ingest-consumer_1 | return callback(*args, **kwargs)
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/runner/commands/run.py”, line 486, in ingest_consumer
ingest-consumer_1 | get_ingest_consumer(consumer_types=consumer_types, **options).run()
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py”, line 257, in run
ingest-consumer_1 | self._run_once()
ingest-consumer_1 | File “/usr/local/lib/python3.6/site-packages/sentry/utils/batching_kafka_consumer.py”, line 275, in _run_once
ingest-consumer_1 | raise Exception(msg.error())
ingest-consumer_1 | Exception: KafkaError{code=COORDINATOR_LOAD_IN_PROGRESS,val=14,str=“JoinGroup failed: Broker: Coordinator load in progress”}
subscription-consumer-transactions_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-events_1 | 05:43:00 [WARNING] batching-kafka-consumer: Topic ‘events-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:01 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
subscription-consumer-transactions_1 | 05:43:01 [WARNING] batching-kafka-consumer: Topic ‘transactions-subscription-results’ or its partitions are not ready, retrying…
snuba-transactions-consumer_1 | 2021-03-09 05:43:05,039 New partitions assigned: {Partition(topic=Topic(name=‘events’), index=0): 0}
snuba-sessions-consumer_1 | 2021-03-09 05:43:05,041 New partitions assigned: {Partition(topic=Topic(name=‘ingest-sessions’), index=0): 0}
subscription-consumer-events_1 | 05:43:07 [INFO] sentry.snuba.query_subscription_consumer: query-subscription-consumer.on_assign (offsets=‘{0: None}’ partitions=‘[TopicPartition{topic=events-subscription-results,partition=0,offset=-1001,error=None}]’)
subscription-consumer-transactions_1 | 05:43:07 [INFO] sentry.snuba.query_subscription_consumer: query-subscription-consumer.on_assign (offsets=‘{0: None}’ partitions=‘[TopicPartition{topic=transactions-subscription-results,partition=0,offset=-1001,error=None}]’)
snuba-subscription-consumer-transactions_1 | 2021-03-09 05:43:08,239 New partitions assigned: {Partition(topic=Topic(name=‘events’), index=0): 0}
relay_1 | 2021-03-09T05:43:09Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 25.62890625s
snuba-outcomes-consumer_1 | + set – snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + set gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-outcomes-consumer_1 | + exec gosu snuba snuba consumer --storage outcomes_raw --auto-offset-reset=earliest --max-batch-time-ms 750
snuba-replacer_1 | + set – snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + set gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-replacer_1 | + exec gosu snuba snuba replacer --storage events --auto-offset-reset=latest --max-batch-size 3
snuba-subscription-consumer-events_1 | + set – snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-events_1 | + set gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-subscription-consumer-events_1 | + exec gosu snuba snuba subscriptions --auto-offset-reset=latest --consumer-group=snuba-events-subscriptions-consumers --topic=events --result-topic=events-subscription-results --dataset=events --commit-log-topic=snuba-commit-log --commit-log-group=snuba-consumers --delay-seconds=60 --schedule-ttl=60
snuba-consumer_1 | + set – snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
snuba-consumer_1 | + set gosu snuba snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
snuba-consumer_1 | + exec gosu snuba snuba consumer --storage events --auto-offset-reset=latest --max-batch-time-ms 750
relay_1 | 2021-03-09T05:43:22Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
snuba-sessions-consumer_1 | 2021-03-09 05:43:23,049 Partitions revoked: [Partition(topic=Topic(name=‘ingest-sessions’), index=0)]
snuba-outcomes-consumer_1 | 2021-03-09 05:43:23,081 New partitions assigned: {Partition(topic=Topic(name=‘outcomes’), index=0): 0}
snuba-consumer_1 | 2021-03-09 05:43:23,083 New partitions assigned: {Partition(topic=Topic(name=‘events’), index=0): 0}
snuba-sessions-consumer_1 | 2021-03-09 05:43:23,479 New partitions assigned: {Partition(topic=Topic(name=‘ingest-sessions’), index=0): 0}
snuba-replacer_1 | 2021-03-09 05:43:23,990 New partitions assigned: {Partition(topic=Topic(name=‘event-replacements’), index=0): 0}
post-process-forwarder_1 | 05:43:24 [INFO] sentry.plugins.github: apps-not-configured
ingest-consumer_1 | 05:43:24 [INFO] sentry.plugins.github: apps-not-configured
web_1 | 05:43:27 [INFO] sentry.plugins.github: apps-not-configured
web_1 | 05:43:27 [INFO] sentry.plugins.github: apps-not-configured
snuba-subscription-consumer-events_1 | 2021-03-09 05:43:27,499 New partitions assigned: {Partition(topic=Topic(name=‘events’), index=0): 0}
web_1 | 05:43:27 [INFO] sentry.plugins.github: apps-not-configured
web_1 | * Unknown config option found: ‘slack.legacy-app’
web_1 | * Unknown config option found: ‘slack.legacy-app’
web_1 | * Unknown config option found: ‘slack.legacy-app’
web_1 | WSGI app 0 (mountpoint=‘’) ready in 34 seconds on interpreter 0x5640c2025ef0 pid: 25 (default app)
web_1 | WSGI app 0 (mountpoint=‘’) ready in 34 seconds on interpreter 0x5640c2025ef0 pid: 24 (default app)
web_1 | WSGI app 0 (mountpoint=‘’) ready in 34 seconds on interpreter 0x5640c2025ef0 pid: 23 (default app)
post-process-forwarder_1 | 05:43:28 [INFO] sentry.eventstream.kafka.backend: Received partition assignment: [TopicPartition{topic=events,partition=0,offset=-1001,error=None}]
ingest-consumer_1 | 05:43:28 [INFO] batching-kafka-consumer: New partitions assigned: [TopicPartition{topic=ingest-attachments,partition=0,offset=-1001,error=None}, TopicPartition{topic=ingest-events,partition=0,offset=-1001,error=None}, TopicPartition{topic=ingest-transactions,partition=0,offset=-1001,error=None}]
relay_1 | 2021-03-09T05:43:35Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 38.443359375s
relay_1 | 2021-03-09T05:44:00Z [relay_server::actors::upstream] ERROR: authentication encountered error: could not send request to upstream
relay_1 | caused by: could not send request using reqwest
relay_1 | caused by: error sending request for url (http://web:9000/api/0/relays/register/challenge/): error trying to connect: dns error: no record found for name: web.google.internal. type: AAAA class: IN
relay_1 | 2021-03-09T05:44:13Z [relay_server::actors::upstream] WARN: Network outage, scheduling another check in 57.665039062s
Defining variables and helpers …