Checking minimum requirements…
Creating volumes for persistent storage…
Created sentry-data.
Created sentry-postgres.
Created sentry-redis.
Created sentry-zookeeper.
Created sentry-kafka.
Created sentry-clickhouse.
Created sentry-symbolicator.
sentry/sentry.conf.py already exists, skipped creation.
sentry/config.yml already exists, skipped creation.
sentry/requirements.txt already exists, skipped creation.
symbolicator/config.yml already exists, skipped creation.
relay/config.yml already exists, skipped creation.
Fetching and updating Docker images…
Some service image(s) must be built from source by running:
docker-compose build cron ingest-consumer post-process-forwarder symbolicator-cleanup web sentry-cleanup worker snuba-cleanup
20.8.0: Pulling from getsentry/sentry
Digest: sha256:f425037c32492dbf31a52bd9c00e597b7fe6a085509095d0272d5e3c50b2f474
Status: Image is up to date for getsentry/sentry:20.8.0
docker.io/getsentry/sentry:20.8.0
Building and tagging Docker images…
Building web
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Successfully tagged sentry-onpremise-local:latest
smtp uses an image, skipping
memcached uses an image, skipping
redis uses an image, skipping
postgres uses an image, skipping
zookeeper uses an image, skipping
kafka uses an image, skipping
clickhouse uses an image, skipping
snuba-api uses an image, skipping
snuba-consumer uses an image, skipping
snuba-outcomes-consumer uses an image, skipping
snuba-sessions-consumer uses an image, skipping
snuba-transactions-consumer uses an image, skipping
snuba-replacer uses an image, skipping
symbolicator uses an image, skipping
relay uses an image, skipping
nginx uses an image, skipping
Building snuba-cleanup …
Building symbolicator-cleanup …
Building web …
Building cron …
Building worker …
Building ingest-consumer …
Building post-process-forwarder …
Building sentry-cleanup …
Building sentry-cleanup
Building web
Building snuba-cleanup
Building cron
Building worker
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
—> 64aba5c1f3ea
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
—> Using cache
—> ba83e990d8d8
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
—> Using cache
—> b85fe1afc1c6
Step 5/5 : ENTRYPOINT [“/entrypoint.sh”]
—> Using cache
—> 904e56ee8fc1
Successfully built 904e56ee8fc1
Successfully tagged snuba-cleanup-onpremise-local:latest
Building snuba-cleanup … done
Building ingest-consumer
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
—> 8f41cc83c64c
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
—> Using cache
—> ab56c01bbbab
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
—> Using cache
—> bdc16e6e0fd5
Step 5/5 : ENTRYPOINT [“/entrypoint.sh”]
—> Using cache
—> da26e398df67
Successfully built da26e398df67
Successfully tagged sentry-cleanup-onpremise-local:latest
Building post-process-forwarder
Building sentry-cleanup … done
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
Successfully tagged sentry-onpremise-local:latest
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
Building cron … done
Building symbolicator-cleanup
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Successfully tagged sentry-onpremise-local:latest
Building web … done
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Successfully tagged sentry-onpremise-local:latest
Building worker … done
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Step 1/4 : ARG SENTRY_IMAGE
Step 2/4 : FROM ${SENTRY_IMAGE}
—> 61c52fc84ac9
Step 3/4 : COPY . /usr/src/sentry
Successfully tagged sentry-onpremise-local:latest
—> Using cache
—> cc938b274b9e
Step 4/4 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
—> Using cache
—> 8f41cc83c64c
Successfully built 8f41cc83c64c
Building ingest-consumer … done
Successfully tagged sentry-onpremise-local:latest
Building post-process-forwarder … done
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
—> 830bb6024b62
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
—> Using cache
—> 8b897cfdfc01
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
—> Using cache
—> d32e48b7d9a3
Step 5/5 : ENTRYPOINT [“/entrypoint.sh”]
—> Using cache
—> 1dfecb880c52
Successfully built 1dfecb880c52
Successfully tagged symbolicator-cleanup-onpremise-local:latest
Building symbolicator-cleanup … done
Docker images built.
Removing network onpremise_default
Network onpremise_default not found.
Removing network sentry_onpremise_default
Network sentry_onpremise_default not found.
Creating network “sentry_onpremise_default” with the default driver
Creating volume “sentry_onpremise_sentry-secrets” with default driver
Creating volume “sentry_onpremise_sentry-smtp” with default driver
Creating volume “sentry_onpremise_sentry-zookeeper-log” with default driver
Creating volume “sentry_onpremise_sentry-kafka-log” with default driver
Creating volume “sentry_onpremise_sentry-smtp-log” with default driver
Creating volume “sentry_onpremise_sentry-clickhouse-log” with default driver
Creating sentry_onpremise_clickhouse_1 …
Creating sentry_onpremise_clickhouse_1 … done
Bootstrapping and migrating Snuba…
Starting sentry_onpremise_clickhouse_1 …
Starting sentry_onpremise_clickhouse_1 … done
Creating sentry_onpremise_zookeeper_1 …
Creating sentry_onpremise_redis_1 …
Creating sentry_onpremise_zookeeper_1 … done
Creating sentry_onpremise_kafka_1 …
Creating sentry_onpremise_redis_1 … done
Creating sentry_onpremise_kafka_1 … done
- ‘[’ b = - ‘]’
- snuba bootstrap --help
- set – snuba bootstrap --force
- set gosu snuba snuba bootstrap --force
- exec gosu snuba snuba bootstrap --force
%3|1600415143.495|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.20.0.5:9092 failed: Connection refused (after 7ms in state CONNECT)
%3|1600415144.488|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.20.0.5:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
2020-09-18 07:45:44,489 Connection to Kafka failed (attempt 0)
Traceback (most recent call last):
File “/usr/src/snuba/snuba/cli/bootstrap.py”, line 56, in bootstrap
client.list_topics(timeout=1)
cimpl.KafkaException: KafkaError{code=_TRANSPORT,val=-195,str=“Failed to get metadata: Local: Broker transport failure”}
%3|1600415145.491|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.20.0.5:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1600415146.491|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#172.20.0.5:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
2020-09-18 07:45:46,493 Connection to Kafka failed (attempt 1)
Traceback (most recent call last):
File “/usr/src/snuba/snuba/cli/bootstrap.py”, line 56, in bootstrap
client.list_topics(timeout=1)
cimpl.KafkaException: KafkaError{code=_TRANSPORT,val=-195,str=“Failed to get metadata: Local: Broker transport failure”}
2020-09-18 07:45:48,148 Topic ingest-sessions created
2020-09-18 07:45:48,148 Topic cdc created
2020-09-18 07:45:48,148 Topic events created
2020-09-18 07:45:48,148 Topic errors-replacements created
2020-09-18 07:45:48,148 Topic event-replacements created
2020-09-18 07:45:48,148 Topic snuba-commit-log created
2020-09-18 07:45:48,148 Topic outcomes created
2020-09-18 07:45:48,165 Creating tables for storage events
2020-09-18 07:45:48,175 Migrating storage events
2020-09-18 07:45:48,182 Executing migration: ALTER TABLE sentry_local ADD COLUMN _tags_hash_map Array(UInt64) MATERIALIZED arrayMap((k, v) → cityHash64(concat(replaceRegexpAll(k, ‘(\=|\\)’, ‘\\\1’), ‘=’, v)), tags.key, tags.value) AFTER _tags_flattened
2020-09-18 07:45:48,198 Creating tables for storage errors
2020-09-18 07:45:48,206 Migrating storage errors
2020-09-18 07:45:48,212 Executing migration: ALTER TABLE errors_local ADD COLUMN _tags_hash_map Array(UInt64) MATERIALIZED arrayMap((k, v) → cityHash64(concat(replaceRegexpAll(k, ‘(\=|\\)’, ‘\\\1’), ‘=’, v)), tags.key, tags.value) AFTER _tags_flattened
2020-09-18 07:45:48,224 Creating tables for storage groupedmessages
2020-09-18 07:45:48,227 Migrating storage groupedmessages
2020-09-18 07:45:48,231 Creating tables for storage groupassignees
2020-09-18 07:45:48,234 Migrating storage groupassignees
2020-09-18 07:45:48,238 Creating tables for storage outcomes_raw
2020-09-18 07:45:48,241 Migrating storage outcomes_raw
2020-09-18 07:45:48,244 Creating tables for storage outcomes_hourly
2020-09-18 07:45:48,248 Migrating storage outcomes_hourly
2020-09-18 07:45:48,251 Creating tables for storage sessions_raw
2020-09-18 07:45:48,255 Migrating storage sessions_raw
2020-09-18 07:45:48,259 Creating tables for storage sessions_hourly
2020-09-18 07:45:48,263 Migrating storage sessions_hourly
2020-09-18 07:45:48,270 Creating tables for storage transactions
2020-09-18 07:45:48,275 Migrating storage transactions
2020-09-18 07:45:48,279 Executing migration: ALTER TABLE transactions_local ADD COLUMN _tags_hash_map Array(UInt64) MATERIALIZED arrayMap((k, v) → cityHash64(concat(replaceRegexpAll(k, ‘(\=|\\)’, ‘\\\1’), ‘=’, v)), tags.key, tags.value) AFTER _tags_flattened
Setting up database…
Starting sentry_onpremise_zookeeper_1 …
Starting sentry_onpremise_zookeeper_1 … done
Creating sentry_onpremise_smtp_1 …
Creating sentry_onpremise_memcached_1 …
Starting sentry_onpremise_redis_1 …
Starting sentry_onpremise_clickhouse_1 …
Creating sentry_onpremise_symbolicator_1 …
Starting sentry_onpremise_clickhouse_1 … done
Starting sentry_onpremise_redis_1 … done
Starting sentry_onpremise_kafka_1 …
Starting sentry_onpremise_kafka_1 … done
Creating sentry_onpremise_postgres_1 …
Creating sentry_onpremise_snuba-sessions-consumer_1 …
Creating sentry_onpremise_snuba-transactions-consumer_1 …
Creating sentry_onpremise_snuba-outcomes-consumer_1 …
Creating sentry_onpremise_snuba-api_1 …
Creating sentry_onpremise_snuba-replacer_1 …
Creating sentry_onpremise_snuba-consumer_1 …
Creating sentry_onpremise_smtp_1 … done
Creating sentry_onpremise_memcached_1 … done
Creating sentry_onpremise_postgres_1 … done
Creating sentry_onpremise_snuba-api_1 … done
Creating sentry_onpremise_symbolicator_1 … done
Creating sentry_onpremise_snuba-outcomes-consumer_1 … done
Creating sentry_onpremise_snuba-replacer_1 … done
Creating sentry_onpremise_snuba-transactions-consumer_1 … done
Creating sentry_onpremise_snuba-sessions-consumer_1 … done
Creating sentry_onpremise_snuba-consumer_1 … done
07:46:02 [WARNING] sentry.utils.geo: settings.GEOIP_PATH_MMDB not configured.
/usr/local/lib/python2.7/site-packages/cryptography/init.py:39: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in a future release.
CryptographyDeprecationWarning,
07:46:08 [INFO] sentry.plugins.github: apps-not-configured
Traceback (most recent call last):
File “/usr/local/bin/sentry”, line 8, in
sys.exit(main())
File “/usr/local/lib/python2.7/site-packages/sentry/runner/init.py”, line 166, in main
cli(prog_name=get_prog(), obj={}, max_content_width=100)
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 722, in call
return self.main(*args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 697, in main
rv = self.invoke(ctx)
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 535, in invoke
return callback(*args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/click/decorators.py”, line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/sentry/runner/decorators.py”, line 30, in inner
return ctx.invoke(f, *args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/click/core.py”, line 535, in invoke
return callback(*args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/click/decorators.py”, line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/sentry/runner/commands/upgrade.py”, line 174, in upgrade
_upgrade(not noinput, traceback, verbosity, not no_repair, with_nodestore)
File “/usr/local/lib/python2.7/site-packages/sentry/runner/commands/upgrade.py”, line 121, in _upgrade
_migrate_from_south(verbosity)
File “/usr/local/lib/python2.7/site-packages/sentry/runner/commands/upgrade.py”, line 93, in _migrate_from_south
if not _has_south_history(connection):
File “/usr/local/lib/python2.7/site-packages/sentry/runner/commands/upgrade.py”, line 78, in _has_south_history
cursor = connection.cursor()
File “/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 254, in cursor
return self._cursor()
File “/usr/local/lib/python2.7/site-packages/sentry/db/postgres/decorators.py”, line 44, in inner
return func(self, *args, **kwargs)
File “/usr/local/lib/python2.7/site-packages/sentry/db/postgres/base.py”, line 97, in _cursor
return super(DatabaseWrapper, self)._cursor()
File “/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 229, in _cursor
self.ensure_connection()
File “/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 213, in ensure_connection
self.connect()
File “/usr/local/lib/python2.7/site-packages/django/db/utils.py”, line 94, in exit
six.reraise(dj_exc_type, dj_exc_value, traceback)
File “/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 213, in ensure_connection
self.connect()
File “/usr/local/lib/python2.7/site-packages/django/db/backends/base/base.py”, line 189, in connect
self.connection = self.get_new_connection(conn_params)
File “/usr/local/lib/python2.7/site-packages/django/db/backends/postgresql/base.py”, line 176, in get_new_connection
connection = Database.connect(**conn_params)
File “/usr/local/lib/python2.7/site-packages/psycopg2/init.py”, line 127, in connect
conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
django.db.utils.OperationalError: could not translate host name “postgres” to address: Temporary failure in name resolution
An error occurred, caught SIGERR on line 253
Cleaning up…
