Closed uhlhosting closed 2 years ago
After some changes I got:
ubuntu@sentry:~/onpremise$ sudo ./install.sh
▶ Parsing command line ...
▶ Initializing Docker Compose ...
▶ Setting up error handling ...
▶ Checking for latest commit ...
▶ Checking minimum requirements ...
Found Docker version 19.03.12
Found Docker Compose version 1.29.2
▶ Turning things off ...
Removing sentry-self-hosted_snuba-replacer_1 ...
Removing sentry-self-hosted_snuba-sessions-consumer_1 ...
Removing sentry-self-hosted_snuba-subscription-consumer-transactions_1 ...
Removing sentry-self-hosted_snuba-transactions-consumer_1 ...
Removing sentry-self-hosted_snuba-subscription-consumer-events_1 ...
Removing sentry-self-hosted_snuba-consumer_1 ...
Removing sentry-self-hosted_snuba-outcomes-consumer_1 ...
Removing sentry-self-hosted_snuba-api_1 ...
Removing sentry-self-hosted_memcached_1 ...
Removing sentry-self-hosted_smtp_1 ...
Removing sentry-self-hosted_postgres_1 ...
Removing sentry-self-hosted_symbolicator_1 ...
Removing sentry-self-hosted_kafka_1 ...
Removing sentry-self-hosted_clickhouse_1 ...
Removing sentry-self-hosted_redis_1 ...
Removing sentry-self-hosted_zookeeper_1 ...
Removing sentry-self-hosted_memcached_1 ... done
Removing sentry-self-hosted_snuba-transactions-consumer_1 ... done
Removing sentry-self-hosted_postgres_1 ... done
Removing sentry-self-hosted_kafka_1 ... done
Removing sentry-self-hosted_redis_1 ... done
Removing sentry-self-hosted_zookeeper_1 ... done
Removing sentry-self-hosted_snuba-consumer_1 ... done
Removing sentry-self-hosted_clickhouse_1 ... done
Removing sentry-self-hosted_snuba-sessions-consumer_1 ... done
Removing sentry-self-hosted_snuba-outcomes-consumer_1 ... done
Removing sentry-self-hosted_snuba-replacer_1 ... done
Removing sentry-self-hosted_symbolicator_1 ... done
Removing sentry-self-hosted_snuba-api_1 ... done
Removing sentry-self-hosted_snuba-subscription-consumer-events_1 ... done
Removing sentry-self-hosted_smtp_1 ... done
Removing sentry-self-hosted_snuba-subscription-consumer-transactions_1 ... done
Removing network sentry-self-hosted_default
Removing network sentry_onpremise_default
Network sentry_onpremise_default not found.
▶ Creating volumes for persistent storage ...
Created sentry-clickhouse.
Created sentry-data.
Created sentry-kafka.
Created sentry-postgres.
Created sentry-redis.
Created sentry-symbolicator.
Created sentry-zookeeper.
▶ Ensuring files from examples ...
../sentry/sentry.conf.py already exists, skipped creation.
../sentry/config.yml already exists, skipped creation.
../symbolicator/config.yml already exists, skipped creation.
../sentry/requirements.txt already exists, skipped creation.
▶ Ensuring Relay credentials ...
../relay/config.yml already exists, skipped creation.
../relay/credentials.json already exists, skipped creation.
▶ Generating secret key ...
▶ Replacing TSDB ...
▶ Fetching and updating Docker images ...
Some service image(s) must be built from source by running:
docker-compose build snuba-transactions-cleanup symbolicator-cleanup sentry-cleanup snuba-cleanup
nightly: Pulling from getsentry/sentry
Digest: sha256:4b6bf04b28c536b67123dab11d3eb235dfbc986dc7eaf43ca5dcb5117e27e69c
Status: Image is up to date for getsentry/sentry:nightly
docker.io/getsentry/sentry:nightly
▶ Building and tagging Docker images ...
smtp uses an image, skipping
memcached uses an image, skipping
redis uses an image, skipping
postgres uses an image, skipping
zookeeper uses an image, skipping
kafka uses an image, skipping
clickhouse uses an image, skipping
geoipupdate uses an image, skipping
snuba-api uses an image, skipping
snuba-consumer uses an image, skipping
snuba-outcomes-consumer uses an image, skipping
snuba-sessions-consumer uses an image, skipping
snuba-transactions-consumer uses an image, skipping
snuba-replacer uses an image, skipping
snuba-subscription-consumer-events uses an image, skipping
snuba-subscription-consumer-transactions uses an image, skipping
symbolicator uses an image, skipping
web uses an image, skipping
cron uses an image, skipping
worker uses an image, skipping
ingest-consumer uses an image, skipping
post-process-forwarder uses an image, skipping
subscription-consumer-events uses an image, skipping
subscription-consumer-transactions uses an image, skipping
relay uses an image, skipping
nginx uses an image, skipping
Building snuba-cleanup
Sending build context to Docker daemon 3.584kB
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
---> 35dd363b8cbe
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
---> Using cache
---> 75046ae0e9fa
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
---> Using cache
---> 02dac5fe6c6f
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
---> Using cache
---> 268e8a98699b
Successfully built 268e8a98699b
Successfully tagged snuba-cleanup-self-hosted-local:latest
Building snuba-transactions-cleanup
Sending build context to Docker daemon 3.584kB
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
---> 35dd363b8cbe
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
---> Using cache
---> 75046ae0e9fa
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
---> Using cache
---> 02dac5fe6c6f
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
---> Using cache
---> 268e8a98699b
Successfully built 268e8a98699b
Successfully tagged snuba-cleanup-self-hosted-local:latest
Building symbolicator-cleanup
Sending build context to Docker daemon 3.584kB
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
---> 0f6e1f086974
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
---> Using cache
---> cf9ddf3638ea
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
---> Using cache
---> a76e81ddf0bf
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
---> Using cache
---> 6e47ec5fd195
Successfully built 6e47ec5fd195
Successfully tagged symbolicator-cleanup-self-hosted-local:latest
Building sentry-cleanup
Sending build context to Docker daemon 3.584kB
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
---> 42419a2fad1e
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*
---> Using cache
---> ba1a7abcae14
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
---> Using cache
---> f439e46b1a28
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
---> Using cache
---> 2cb444432df5
Successfully built 2cb444432df5
Successfully tagged sentry-cleanup-self-hosted-local:latest
Docker images built.
▶ Setting up Zookeeper ...
Creating network "sentry-self-hosted_default" with the default driver
Creating sentry-self-hosted_zookeeper_run ...
Creating sentry-self-hosted_zookeeper_run ... done
Creating sentry-self-hosted_zookeeper_run ...
Creating sentry-self-hosted_zookeeper_run ... done
Creating sentry-self-hosted_zookeeper_run ...
Creating sentry-self-hosted_zookeeper_run ... done
▶ Downloading and installing wal2json ...
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 5417 100 5417 0 0 29057 0 --:--:-- --:--:-- --:--:-- 29123
▶ Bootstrapping and migrating Snuba ...
Creating sentry-self-hosted_zookeeper_1 ...
Creating sentry-self-hosted_redis_1 ...
Creating sentry-self-hosted_clickhouse_1 ...
Creating sentry-self-hosted_redis_1 ... done
Creating sentry-self-hosted_clickhouse_1 ... done
Creating sentry-self-hosted_zookeeper_1 ... done
Creating sentry-self-hosted_kafka_1 ...
Creating sentry-self-hosted_kafka_1 ... done
Creating sentry-self-hosted_snuba-api_run ...
Creating sentry-self-hosted_snuba-api_run ... done
2022-04-03 10:00:17,674 Attempting to connect to Kafka (attempt 0)...
2022-04-03 10:00:17,695 Connected to Kafka on attempt 0
2022-04-03 10:00:17,696 Creating Kafka topics...
Creating sentry-self-hosted_snuba-api_run ...
Creating sentry-self-hosted_snuba-api_run ... done
Finished running migrations
▶ Creating additional Kafka topics ...
▶ Ensuring proper PostgreSQL version ...
▶ Setting up / migrating database ...
Creating sentry-self-hosted_postgres_1 ...
Creating sentry-self-hosted_smtp_1 ...
Creating sentry-self-hosted_memcached_1 ...
Creating sentry-self-hosted_symbolicator_1 ...
Creating sentry-self-hosted_snuba-outcomes-consumer_1 ...
Creating sentry-self-hosted_snuba-replacer_1 ...
Creating sentry-self-hosted_snuba-consumer_1 ...
Creating sentry-self-hosted_snuba-api_1 ...
Creating sentry-self-hosted_snuba-sessions-consumer_1 ...
Creating sentry-self-hosted_snuba-transactions-consumer_1 ...
Creating sentry-self-hosted_snuba-subscription-consumer-events_1 ...
Creating sentry-self-hosted_snuba-subscription-consumer-transactions_1 ...
Creating sentry-self-hosted_symbolicator_1 ... done
Creating sentry-self-hosted_snuba-sessions-consumer_1 ... done
Creating sentry-self-hosted_snuba-api_1 ... done
Creating sentry-self-hosted_snuba-subscription-consumer-events_1 ... done
Creating sentry-self-hosted_memcached_1 ... done
Creating sentry-self-hosted_snuba-replacer_1 ... done
Creating sentry-self-hosted_smtp_1 ... done
Creating sentry-self-hosted_snuba-consumer_1 ... done
Creating sentry-self-hosted_postgres_1 ... done
Creating sentry-self-hosted_snuba-subscription-consumer-transactions_1 ... done
Creating sentry-self-hosted_snuba-transactions-consumer_1 ... done
Creating sentry-self-hosted_snuba-outcomes-consumer_1 ... done
Creating sentry-self-hosted_web_run ...
Creating sentry-self-hosted_web_run ... done
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
Traceback (most recent call last):
File "/usr/local/bin/sentry", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.8/site-packages/sentry/runner/__init__.py", line 188, in main
func(**kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sentry/runner/decorators.py", line 28, in inner
configure()
File "/usr/local/lib/python3.8/site-packages/sentry/runner/__init__.py", line 124, in configure
configure(ctx, py, yaml, skip_service_validation)
File "/usr/local/lib/python3.8/site-packages/sentry/runner/settings.py", line 153, in configure
initialize_app(
File "/usr/local/lib/python3.8/site-packages/sentry/runner/initializer.py", line 353, in initialize_app
django.setup()
File "/usr/local/lib/python3.8/site-packages/django/__init__.py", line 24, in setup
apps.populate(settings.INSTALLED_APPS)
File "/usr/local/lib/python3.8/site-packages/django/apps/registry.py", line 114, in populate
app_config.import_models()
File "/usr/local/lib/python3.8/site-packages/django/apps/config.py", line 211, in import_models
self.models_module = import_module(models_module_name)
File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 843, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/sentry_interface_types/models.py", line 2, in <module>
from sentry.plugins.bases.tag import TagPlugin
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/bases/__init__.py", line 1, in <module>
from .issue import IssueTrackingPlugin # NOQA
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/bases/issue.py", line 7, in <module>
from sentry.plugins.base.v1 import Plugin
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/base/__init__.py", line 1, in <module>
from .bindings import BindingManager
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/base/bindings.py", line 1, in <module>
from sentry.plugins.providers import IntegrationRepositoryProvider, RepositoryProvider
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/providers/__init__.py", line 8, in <module>
from .integration_repository import IntegrationRepositoryProvider
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/providers/integration_repository.py", line 12, in <module>
from sentry.api.serializers import serialize
File "/usr/local/lib/python3.8/site-packages/sentry/api/__init__.py", line 2, in <module>
from .client import ApiClient
File "/usr/local/lib/python3.8/site-packages/sentry/api/client.py", line 6, in <module>
from sentry.auth.superuser import Superuser
File "/usr/local/lib/python3.8/site-packages/sentry/auth/superuser.py", line 22, in <module>
from sentry.auth.system import is_system_auth
File "/usr/local/lib/python3.8/site-packages/sentry/auth/system.py", line 12, in <module>
INTERNAL_NETWORKS = [
File "/usr/local/lib/python3.8/site-packages/sentry/auth/system.py", line 13, in <listcomp>
ipaddress.ip_network(str(net), strict=False) for net in settings.INTERNAL_SYSTEM_IPS
File "/usr/local/lib/python3.8/ipaddress.py", line 83, in ip_network
raise ValueError('%r does not appear to be an IPv4 or IPv6 network' %
ValueError: "('172.23.0.0/16',)" does not appear to be an IPv4 or IPv6 network
1
An error occurred, caught SIGERR on line 12
Cleaning up...
ubuntu@sentry:~/onpremise$
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel state UP group default qlen 1000
link/ether 3e:4a:94:b9:28:1a brd ff:ff:ff:ff:ff:ff
inet 92.xxx.242.xxx/27 brd 92.222.242.255 scope global eth0
valid_lft forever preferred_lft forever
inet6 fe80::3c4a:94ff:feb9:281a/64 scope link
valid_lft forever preferred_lft forever
4: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
link/ether 02:42:9d:76:2f:8b brd ff:ff:ff:ff:ff:ff
inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0
valid_lft forever preferred_lft forever
inet6 fe80::42:9dff:fe76:2f8b/64 scope link
valid_lft forever preferred_lft forever
366: br-07bc7769fa4e: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN group default
link/ether 02:42:51:31:b2:df brd ff:ff:ff:ff:ff:ff
inet 172.23.0.1/16 brd 172.23.255.255 scope global br-07bc7769fa4e
valid_lft forever preferred_lft forever
inet6 fe80::42:51ff:fe31:b2df/64 scope link
valid_lft forever preferred_lft forever
If this a first install, clean everything (docker-compose down -v --remove-orphans
) and try with latest sentry release (or least the ones after 21.6.3).
@aminvakil this is an upgrade, unfortunatelly havent upgraded the machine in past 2 years.
We still receive:
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
Traceback (most recent call last):
File "/usr/local/bin/sentry", line 8, in <module>
sys.exit(main())
File "/usr/local/lib/python3.8/site-packages/sentry/runner/__init__.py", line 188, in main
func(**kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 829, in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 782, in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.8/site-packages/click/core.py", line 610, in invoke
return callback(*args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/click/decorators.py", line 21, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.8/site-packages/sentry/runner/decorators.py", line 28, in inner
configure()
File "/usr/local/lib/python3.8/site-packages/sentry/runner/__init__.py", line 124, in configure
configure(ctx, py, yaml, skip_service_validation)
File "/usr/local/lib/python3.8/site-packages/sentry/runner/settings.py", line 153, in configure
initialize_app(
File "/usr/local/lib/python3.8/site-packages/sentry/runner/initializer.py", line 353, in initialize_app
django.setup()
File "/usr/local/lib/python3.8/site-packages/django/__init__.py", line 24, in setup
apps.populate(settings.INSTALLED_APPS)
File "/usr/local/lib/python3.8/site-packages/django/apps/registry.py", line 114, in populate
app_config.import_models()
File "/usr/local/lib/python3.8/site-packages/django/apps/config.py", line 211, in import_models
self.models_module = import_module(models_module_name)
File "/usr/local/lib/python3.8/importlib/__init__.py", line 127, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1014, in _gcd_import
File "<frozen importlib._bootstrap>", line 991, in _find_and_load
File "<frozen importlib._bootstrap>", line 975, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 671, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 843, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/sentry_interface_types/models.py", line 2, in <module>
from sentry.plugins.bases.tag import TagPlugin
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/bases/__init__.py", line 1, in <module>
from .issue import IssueTrackingPlugin # NOQA
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/bases/issue.py", line 7, in <module>
from sentry.plugins.base.v1 import Plugin
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/base/__init__.py", line 1, in <module>
from .bindings import BindingManager
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/base/bindings.py", line 1, in <module>
from sentry.plugins.providers import IntegrationRepositoryProvider, RepositoryProvider
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/providers/__init__.py", line 8, in <module>
from .integration_repository import IntegrationRepositoryProvider
File "/usr/local/lib/python3.8/site-packages/sentry/plugins/providers/integration_repository.py", line 12, in <module>
from sentry.api.serializers import serialize
File "/usr/local/lib/python3.8/site-packages/sentry/api/__init__.py", line 2, in <module>
from .client import ApiClient
File "/usr/local/lib/python3.8/site-packages/sentry/api/client.py", line 6, in <module>
from sentry.auth.superuser import Superuser
File "/usr/local/lib/python3.8/site-packages/sentry/auth/superuser.py", line 22, in <module>
from sentry.auth.system import is_system_auth
File "/usr/local/lib/python3.8/site-packages/sentry/auth/system.py", line 12, in <module>
INTERNAL_NETWORKS = [
File "/usr/local/lib/python3.8/site-packages/sentry/auth/system.py", line 13, in <listcomp>
ipaddress.ip_network(str(net), strict=False) for net in settings.INTERNAL_SYSTEM_IPS
File "/usr/local/lib/python3.8/ipaddress.py", line 83, in ip_network
raise ValueError('%r does not appear to be an IPv4 or IPv6 network' %
ValueError: "('172.24.0.0/16',)" does not appear to be an IPv4 or IPv6 network
1
An error occurred, caught SIGERR on line 12
Cleaning up...
Btw I made a full restore, reseted my pwd and managed to login and see my real version. What upgrade steps would you recommend based on my release, its one of the earli 20.x I think.
After reruning on a restored machine, I got;
/usr/local/lib/python3.8/site-packages/sentry/runner/initializer.py:551: DeprecatedSettingWarning: The SENTRY_URL_PREFIX setting is deprecated. Please use SENTRY_OPTIONS['system.url-prefix'] instead.
warnings.warn(DeprecatedSettingWarning(old, "SENTRY_OPTIONS['%s']" % new))
/usr/local/lib/python3.8/site-packages/memcache.py:1303: SyntaxWarning: "is" with a literal. Did you mean "=="?
if key is '':
/usr/local/lib/python3.8/site-packages/memcache.py:1304: SyntaxWarning: "is" with a literal. Did you mean "=="?
if key_extra_len is 0:
16:30:18 [INFO] sentry.plugins.github: apps-not-configured
Error: It looks like you've skipped a hard stop in our upgrade process. Please follow the upgrade process here: https://develop.sentry.dev/self-hosted/releases/#hard-stops
1
An error occurred, caught SIGERR on line 12
Cleaning up...
Have you upgraded considering https://develop.sentry.dev/self-hosted/releases/#hard-stops ?
Well from Sentry 20.9.0.dev0c1823cb not sure what would be the best update steps. For now we made a clean deployment that we test.
@uhlhosting Please read the link I've just sent.
This issue has gone three weeks without activity. In another week, I will close it.
But! If you comment or otherwise update it, I will reset the clock, and if you label it Status: Backlog
or Status: In Progress
, I will leave it alone ... forever!
"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀
Version
Sentry 20.9.0.dev0c1823cb
Steps to Reproduce
I pulled latest git repo.
And runned install.sh . At first it failed with wrong docker-composer version, I since then upgraded docker-compose the install continued up to this:
Expected Result
I expected to have a succesful upgrade.
Actual Result
root@sentry:/home/ubuntu/onpremise# ./install.sh ▶ Parsing command line ...
▶ Initializing Docker Compose ...
▶ Setting up error handling ...
▶ Checking for latest commit ...
▶ Checking minimum requirements ... Found Docker version 19.03.12 Found Docker Compose version 1.29.2
▶ Turning things off ... Removing network sentry-self-hosted_default Network sentry-self-hosted_default not found. Stopping sentry_onpremise_nginx_1 ... Stopping sentry_onpremise_post-process-forwarder_1 ... Stopping sentry_onpremise_worker_1 ... Stopping sentry_onpremise_cron_1 ... Stopping sentry_onpremise_ingest-consumer_1 ... Stopping sentry_onpremise_sentry-cleanup_1 ... Stopping sentry_onpremise_web_1 ... Stopping sentry_onpremise_snuba-cleanup_1 ... Stopping sentry_onpremise_relay_1 ... Stopping sentry_onpremise_symbolicator-cleanup_1 ... Stopping sentry_onpremise_snuba-replacer_1 ... Stopping sentry_onpremise_snuba-transactions-consumer_1 ... Stopping sentry_onpremise_snuba-outcomes-consumer_1 ... Stopping sentry_onpremise_snuba-api_1 ... Stopping sentry_onpremise_snuba-consumer_1 ... Stopping sentry_onpremise_snuba-sessions-consumer_1 ... Stopping sentry_onpremise_postgres_1 ... Stopping sentry_onpremise_symbolicator_1 ... Stopping sentry_onpremise_smtp_1 ... Stopping sentry_onpremise_memcached_1 ... Stopping sentry_onpremise_kafka_1 ... Stopping sentry_onpremise_zookeeper_1 ... Stopping sentry_onpremise_redis_1 ... Stopping sentry_onpremise_clickhouse_1 ... Stopping sentry_onpremise_post-process-forwarder_1 ... done Stopping sentry_onpremise_nginx_1 ... done Stopping sentry_onpremise_cron_1 ... done Stopping sentry_onpremise_ingest-consumer_1 ... done Stopping sentry_onpremise_worker_1 ... done Stopping sentry_onpremise_relay_1 ... done Stopping sentry_onpremise_web_1 ... done Stopping sentry_onpremise_sentry-cleanup_1 ... done Stopping sentry_onpremise_snuba-cleanup_1 ... done Stopping sentry_onpremise_symbolicator-cleanup_1 ... done Stopping sentry_onpremise_memcached_1 ... done Stopping sentry_onpremise_smtp_1 ... done Stopping sentry_onpremise_postgres_1 ... done Stopping sentry_onpremise_symbolicator_1 ... done Stopping sentry_onpremise_snuba-replacer_1 ... done Stopping sentry_onpremise_snuba-consumer_1 ... done Stopping sentry_onpremise_snuba-transactions-consumer_1 ... done Stopping sentry_onpremise_snuba-sessions-consumer_1 ... done Stopping sentry_onpremise_snuba-outcomes-consumer_1 ... done Stopping sentry_onpremise_snuba-api_1 ... done Stopping sentry_onpremise_redis_1 ... done Stopping sentry_onpremise_clickhouse_1 ... done Stopping sentry_onpremise_kafka_1 ... done Stopping sentry_onpremise_zookeeper_1 ... done Removing sentry_onpremise_nginx_1 ... Removing sentry_onpremise_post-process-forwarder_1 ... Removing sentry_onpremise_worker_1 ... Removing sentry_onpremise_cron_1 ... Removing sentry_onpremise_ingest-consumer_1 ... Removing sentry_onpremise_sentry-cleanup_1 ... Removing sentry_onpremise_web_1 ... Removing sentry_onpremise_snuba-cleanup_1 ... Removing sentry_onpremise_relay_1 ... Removing sentry_onpremise_symbolicator-cleanup_1 ... Removing sentry_onpremise_snuba-replacer_1 ... Removing sentry_onpremise_snuba-transactions-consumer_1 ... Removing sentry_onpremise_snuba-outcomes-consumer_1 ... Removing sentry_onpremise_snuba-api_1 ... Removing sentry_onpremise_snuba-consumer_1 ... Removing sentry_onpremise_snuba-sessions-consumer_1 ... Removing sentry_onpremise_postgres_1 ... Removing sentry_onpremise_symbolicator_1 ... Removing sentry_onpremise_smtp_1 ... Removing sentry_onpremise_memcached_1 ... Removing sentry_onpremise_kafka_1 ... Removing sentry_onpremise_zookeeper_1 ... Removing sentry_onpremise_redis_1 ... Removing sentry_onpremise_clickhouse_1 ... Removing sentry_onpremise_clickhouse_1 ... done Removing sentry_onpremise_memcached_1 ... done Removing sentry_onpremise_snuba-consumer_1 ... done Removing sentry_onpremise_worker_1 ... done Removing sentry_onpremise_snuba-sessions-consumer_1 ... done Removing sentry_onpremise_ingest-consumer_1 ... done Removing sentry_onpremise_zookeeper_1 ... done Removing sentry_onpremise_snuba-outcomes-consumer_1 ... done Removing sentry_onpremise_snuba-replacer_1 ... done Removing sentry_onpremise_snuba-api_1 ... done Removing sentry_onpremise_redis_1 ... done Removing sentry_onpremise_sentry-cleanup_1 ... done Removing sentry_onpremise_web_1 ... done Removing sentry_onpremise_relay_1 ... done Removing sentry_onpremise_symbolicator_1 ... done Removing sentry_onpremise_post-process-forwarder_1 ... done Removing sentry_onpremise_kafka_1 ... done Removing sentry_onpremise_cron_1 ... done Removing sentry_onpremise_postgres_1 ... done Removing sentry_onpremise_snuba-transactions-consumer_1 ... done Removing sentry_onpremise_nginx_1 ... done Removing sentry_onpremise_smtp_1 ... done Removing sentry_onpremise_snuba-cleanup_1 ... done Removing sentry_onpremise_symbolicator-cleanup_1 ... done Removing network sentry_onpremise_default
▶ Creating volumes for persistent storage ... Created sentry-clickhouse. Created sentry-data. Created sentry-kafka. Created sentry-postgres. Created sentry-redis. Created sentry-symbolicator. Created sentry-zookeeper.
▶ Ensuring files from examples ... ../sentry/sentry.conf.py already exists, skipped creation. ../sentry/config.yml already exists, skipped creation. ../symbolicator/config.yml already exists, skipped creation. ../sentry/requirements.txt already exists, skipped creation.
▶ Ensuring Relay credentials ... ../relay/config.yml already exists, skipped creation. ../relay/credentials.json already exists, skipped creation.
▶ Generating secret key ...
▶ Replacing TSDB ...
▶ Fetching and updating Docker images ... Some service image(s) must be built from source by running: docker-compose build symbolicator-cleanup sentry-cleanup snuba-cleanup snuba-transactions-cleanup nightly: Pulling from getsentry/sentry Digest: sha256:4b6bf04b28c536b67123dab11d3eb235dfbc986dc7eaf43ca5dcb5117e27e69c Status: Image is up to date for getsentry/sentry:nightly docker.io/getsentry/sentry:nightly
▶ Building and tagging Docker images ...
smtp uses an image, skipping memcached uses an image, skipping redis uses an image, skipping postgres uses an image, skipping zookeeper uses an image, skipping kafka uses an image, skipping clickhouse uses an image, skipping geoipupdate uses an image, skipping snuba-api uses an image, skipping snuba-consumer uses an image, skipping snuba-outcomes-consumer uses an image, skipping snuba-sessions-consumer uses an image, skipping snuba-transactions-consumer uses an image, skipping snuba-replacer uses an image, skipping snuba-subscription-consumer-events uses an image, skipping snuba-subscription-consumer-transactions uses an image, skipping symbolicator uses an image, skipping web uses an image, skipping cron uses an image, skipping worker uses an image, skipping ingest-consumer uses an image, skipping post-process-forwarder uses an image, skipping subscription-consumer-events uses an image, skipping subscription-consumer-transactions uses an image, skipping relay uses an image, skipping nginx uses an image, skipping Building snuba-cleanup Sending build context to Docker daemon 3.584kB Step 1/5 : ARG BASE_IMAGE Step 2/5 : FROM ${BASE_IMAGE} ---> 35dd363b8cbe Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/ ---> Running in f3b1200294dc Get:1 http://security.debian.org/debian-security bullseye-security InRelease [44.1 kB] Get:2 http://deb.debian.org/debian bullseye InRelease [116 kB] Get:3 http://deb.debian.org/debian bullseye-updates InRelease [39.4 kB] Get:4 http://security.debian.org/debian-security bullseye-security/main amd64 Packages [124 kB] Get:5 http://deb.debian.org/debian bullseye/main amd64 Packages [8182 kB] Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [2596 B] Fetched 8508 kB in 1s (8313 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: sensible-utils Suggested packages: anacron logrotate checksecurity Recommended packages: default-mta | mail-transport-agent The following NEW packages will be installed: cron sensible-utils 0 upgraded, 2 newly installed, 0 to remove and 10 not upgraded. Need to get 114 kB of archives. After this operation, 314 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian bullseye/main amd64 sensible-utils all 0.0.14 [14.8 kB] Get:2 http://deb.debian.org/debian bullseye/main amd64 cron amd64 3.0pl1-137 [99.6 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 114 kB in 0s (2008 kB/s) Selecting previously unselected package sensible-utils. (Reading database ... 7023 files and directories currently installed.) Preparing to unpack .../sensible-utils_0.0.14_all.deb ... Unpacking sensible-utils (0.0.14) ... Selecting previously unselected package cron. Preparing to unpack .../cron_3.0pl1-137_amd64.deb ... Unpacking cron (3.0pl1-137) ... Setting up sensible-utils (0.0.14) ... Setting up cron (3.0pl1-137) ... Adding group `crontab' (GID 101) ... Done. invoke-rc.d: could not determine current runlevel invoke-rc.d: policy-rc.d denied execution of start. Removing intermediate container f3b1200294dc ---> 75046ae0e9fa Step 4/5 : COPY entrypoint.sh /entrypoint.sh ---> 02dac5fe6c6f Step 5/5 : ENTRYPOINT ["/entrypoint.sh"] ---> Running in f0b22b55191d Removing intermediate container f0b22b55191d ---> 268e8a98699b Successfully built 268e8a98699b Successfully tagged snuba-cleanup-self-hosted-local:latest Building snuba-transactions-cleanup Sending build context to Docker daemon 3.584kB Step 1/5 : ARG BASE_IMAGE Step 2/5 : FROM ${BASE_IMAGE} ---> 35dd363b8cbe Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/ ---> Using cache ---> 75046ae0e9fa Step 4/5 : COPY entrypoint.sh /entrypoint.sh ---> Using cache ---> 02dac5fe6c6f Step 5/5 : ENTRYPOINT ["/entrypoint.sh"] ---> Using cache ---> 268e8a98699b Successfully built 268e8a98699b Successfully tagged snuba-cleanup-self-hosted-local:latest Building symbolicator-cleanup Sending build context to Docker daemon 3.584kB Step 1/5 : ARG BASE_IMAGE Step 2/5 : FROM ${BASE_IMAGE} ---> 0f6e1f086974 Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/ ---> Running in 71299ad54751 Get:1 http://security.debian.org/debian-security stretch/updates InRelease [53.0 kB] Ign:2 http://deb.debian.org/debian stretch InRelease Get:3 http://deb.debian.org/debian stretch-updates InRelease [93.6 kB] Get:4 http://deb.debian.org/debian stretch Release [118 kB] Get:5 http://deb.debian.org/debian stretch Release.gpg [3177 B] Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [759 kB] Get:7 http://deb.debian.org/debian stretch/main amd64 Packages [7080 kB] Fetched 8107 kB in 1s (7688 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... Suggested packages: anacron logrotate checksecurity Recommended packages: exim4 | postfix | mail-transport-agent The following NEW packages will be installed: cron 0 upgraded, 1 newly installed, 0 to remove and 2 not upgraded. Need to get 96.6 kB of archives. After this operation, 257 kB of additional disk space will be used. Get:1 http://security.debian.org/debian-security stretch/updates/main amd64 cron amd64 3.0pl1-128+deb9u2 [96.6 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 96.6 kB in 0s (3759 kB/s) Selecting previously unselected package cron. (Reading database ... 6674 files and directories currently installed.) Preparing to unpack .../cron_3.0pl1-128+deb9u2_amd64.deb ... Unpacking cron (3.0pl1-128+deb9u2) ... Setting up cron (3.0pl1-128+deb9u2) ... Adding group `crontab' (GID 101) ... Done. update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults invoke-rc.d: could not determine current runlevel invoke-rc.d: policy-rc.d denied execution of start. Removing intermediate container 71299ad54751 ---> cf9ddf3638ea Step 4/5 : COPY entrypoint.sh /entrypoint.sh ---> a76e81ddf0bf Step 5/5 : ENTRYPOINT ["/entrypoint.sh"] ---> Running in 3bc0f5bb06e4 Removing intermediate container 3bc0f5bb06e4 ---> 6e47ec5fd195 Successfully built 6e47ec5fd195 Successfully tagged symbolicator-cleanup-self-hosted-local:latest Building sentry-cleanup Sending build context to Docker daemon 3.584kB Step 1/5 : ARG BASE_IMAGE Step 2/5 : FROM ${BASE_IMAGE} ---> 42419a2fad1e Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/ ---> Running in 3f4b66ba51e2 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB] Get:2 http://security.debian.org/debian-security bullseye-security InRelease [44.1 kB] Get:3 http://deb.debian.org/debian bullseye-updates InRelease [39.4 kB] Get:4 http://security.debian.org/debian-security bullseye-security/main amd64 Packages [124 kB] Get:5 http://deb.debian.org/debian bullseye/main amd64 Packages [8182 kB] Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [2596 B] Fetched 8508 kB in 1s (8028 kB/s) Reading package lists... Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: sensible-utils Suggested packages: anacron logrotate checksecurity Recommended packages: default-mta | mail-transport-agent The following NEW packages will be installed: cron sensible-utils 0 upgraded, 2 newly installed, 0 to remove and 18 not upgraded. Need to get 114 kB of archives. After this operation, 314 kB of additional disk space will be used. Get:1 http://deb.debian.org/debian bullseye/main amd64 sensible-utils all 0.0.14 [14.8 kB] Get:2 http://deb.debian.org/debian bullseye/main amd64 cron amd64 3.0pl1-137 [99.6 kB] debconf: delaying package configuration, since apt-utils is not installed Fetched 114 kB in 0s (2017 kB/s) Selecting previously unselected package sensible-utils. (Reading database ... 12313 files and directories currently installed.) Preparing to unpack .../sensible-utils_0.0.14_all.deb ... Unpacking sensible-utils (0.0.14) ... Selecting previously unselected package cron. Preparing to unpack .../cron_3.0pl1-137_amd64.deb ... Unpacking cron (3.0pl1-137) ... Setting up sensible-utils (0.0.14) ... Setting up cron (3.0pl1-137) ... Adding group `crontab' (GID 101) ... Done. invoke-rc.d: could not determine current runlevel invoke-rc.d: policy-rc.d denied execution of start. Removing intermediate container 3f4b66ba51e2 ---> ba1a7abcae14 Step 4/5 : COPY entrypoint.sh /entrypoint.sh ---> f439e46b1a28 Step 5/5 : ENTRYPOINT ["/entrypoint.sh"] ---> Running in e02fa1e12e93 Removing intermediate container e02fa1e12e93 ---> 2cb444432df5 Successfully built 2cb444432df5 Successfully tagged sentry-cleanup-self-hosted-local:latest
Docker images built.
▶ Setting up Zookeeper ... Creating network "sentry-self-hosted_default" with the default driver Creating volume "sentry-self-hosted_sentry-secrets" with default driver Creating volume "sentry-self-hosted_sentry-smtp" with default driver Creating volume "sentry-self-hosted_sentry-zookeeper-log" with default driver Creating volume "sentry-self-hosted_sentry-kafka-log" with default driver Creating volume "sentry-self-hosted_sentry-smtp-log" with default driver Creating volume "sentry-self-hosted_sentry-clickhouse-log" with default driver Creating sentry-self-hosted_zookeeper_run ... Creating sentry-self-hosted_zookeeper_run ... done Creating sentry-self-hosted_zookeeper_run ... Creating sentry-self-hosted_zookeeper_run ... done Creating sentry-self-hosted_zookeeper_run ... Creating sentry-self-hosted_zookeeper_run ... done
▶ Downloading and installing wal2json ... Unable to find image 'curlimages/curl:7.77.0' locally 7.77.0: Pulling from curlimages/curl 339de151aab4: Pulling fs layer 9576f9a419e9: Pulling fs layer 5b67e0e9bce9: Pulling fs layer 7c0640a6c519: Pulling fs layer 1d8f7d50664a: Pulling fs layer 3ce74da83aeb: Pulling fs layer 7094fabf5e16: Pulling fs layer 2f4d0b649c1f: Pulling fs layer 110e7f874674: Pulling fs layer 7c0640a6c519: Waiting 1d8f7d50664a: Waiting 3ce74da83aeb: Waiting 7094fabf5e16: Waiting 110e7f874674: Waiting 2f4d0b649c1f: Waiting 5b67e0e9bce9: Verifying Checksum 5b67e0e9bce9: Download complete 9576f9a419e9: Verifying Checksum 9576f9a419e9: Download complete 339de151aab4: Verifying Checksum 339de151aab4: Download complete 339de151aab4: Pull complete 1d8f7d50664a: Download complete 9576f9a419e9: Pull complete 7c0640a6c519: Download complete 5b67e0e9bce9: Pull complete 7c0640a6c519: Pull complete 1d8f7d50664a: Pull complete 3ce74da83aeb: Verifying Checksum 3ce74da83aeb: Download complete 3ce74da83aeb: Pull complete 7094fabf5e16: Verifying Checksum 7094fabf5e16: Download complete 7094fabf5e16: Pull complete 2f4d0b649c1f: Verifying Checksum 2f4d0b649c1f: Download complete 2f4d0b649c1f: Pull complete 110e7f874674: Verifying Checksum 110e7f874674: Download complete 110e7f874674: Pull complete Digest: sha256:6e0a786e3e5181df00eaf3a0a1749c18a6bb20b01c9bd192ea72176ce8a1c94b Status: Downloaded newer image for curlimages/curl:7.77.0 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 5417 100 5417 0 0 28276 0 --:--:-- --:--:-- --:--:-- 28361 % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 669 100 669 0 0 3787 0 --:--:-- --:--:-- --:--:-- 3801 100 101k 100 101k 0 0 251k 0 --:--:-- --:--:-- --:--:-- 251k
▶ Bootstrapping and migrating Snuba ... Creating sentry-self-hosted_redis_1 ... Creating sentry-self-hosted_zookeeper_1 ... Creating sentry-self-hosted_clickhouse_1 ... Creating sentry-self-hosted_redis_1 ... done Creating sentry-self-hosted_clickhouse_1 ... done Creating sentry-self-hosted_zookeeper_1 ... done Creating sentry-self-hosted_kafka_1 ... Creating sentry-self-hosted_kafka_1 ... done Creating sentry-self-hosted_snuba-api_run ... Creating sentry-self-hosted_snuba-api_run ... done 2022-04-03 09:24:05,553 Attempting to connect to Kafka (attempt 0)... 2022-04-03 09:24:05,572 Connected to Kafka on attempt 0 2022-04-03 09:24:05,572 Creating Kafka topics... 2022-04-03 09:24:05,850 Topic snuba-metrics created 2022-04-03 09:24:05,851 Topic snuba-sessions-commit-log created 2022-04-03 09:24:05,851 Topic snuba-metrics-commit-log created 2022-04-03 09:24:05,851 Topic scheduled-subscriptions-events created 2022-04-03 09:24:05,851 Topic scheduled-subscriptions-transactions created 2022-04-03 09:24:05,851 Topic scheduled-subscriptions-sessions created 2022-04-03 09:24:05,851 Topic scheduled-subscriptions-metrics created 2022-04-03 09:24:05,851 Topic events-subscription-results created 2022-04-03 09:24:05,851 Topic transactions-subscription-results created 2022-04-03 09:24:05,851 Topic sessions-subscription-results created 2022-04-03 09:24:05,851 Topic metrics-subscription-results created 2022-04-03 09:24:05,851 Topic snuba-queries created 2022-04-03 09:24:05,851 Topic processed-profiles created 2022-04-03 09:24:05,851 Topic snuba-dead-letter-inserts created Creating sentry-self-hosted_snuba-api_run ... Creating sentry-self-hosted_snuba-api_run ... done 2022-04-03 09:24:09,489 Running migration: 0001_migrations 2022-04-03 09:24:09,497 Finished: 0001_migrations /usr/local/lib/python3.8/site-packages/clickhouse_driver/columns/datetimecolumn.py:199: PytzUsageWarning: The zone attribute is specific to pytz's interface; please migrate to a new time zone provider. For more details on how to do so, see https://pytz-deprecation-shim.readthedocs.io/en/latest/migration.html local_timezone = get_localzone().zone 2022-04-03 09:24:09,508 Running migration: 0001_events_initial 2022-04-03 09:24:09,513 Finished: 0001_events_initial 2022-04-03 09:24:09,518 Running migration: 0002_events_onpremise_compatibility 2022-04-03 09:24:09,589 Finished: 0002_events_onpremise_compatibility 2022-04-03 09:24:09,595 Running migration: 0003_errors 2022-04-03 09:24:09,603 Finished: 0003_errors 2022-04-03 09:24:09,608 Running migration: 0004_errors_onpremise_compatibility 2022-04-03 09:24:09,618 Finished: 0004_errors_onpremise_compatibility 2022-04-03 09:24:09,622 Running migration: 0005_events_tags_hash_map 2022-04-03 09:24:09,633 Finished: 0005_events_tags_hash_map 2022-04-03 09:24:09,637 Running migration: 0006_errors_tags_hash_map 2022-04-03 09:24:09,648 Finished: 0006_errors_tags_hash_map 2022-04-03 09:24:09,654 Running migration: 0007_groupedmessages 2022-04-03 09:24:09,659 Finished: 0007_groupedmessages 2022-04-03 09:24:09,663 Running migration: 0008_groupassignees 2022-04-03 09:24:09,668 Finished: 0008_groupassignees 2022-04-03 09:24:09,672 Running migration: 0009_errors_add_http_fields 2022-04-03 09:24:09,690 Finished: 0009_errors_add_http_fields 2022-04-03 09:24:09,694 Running migration: 0010_groupedmessages_onpremise_compatibility 2022-04-03 09:24:09,700 Finished: 0010_groupedmessages_onpremise_compatibility 2022-04-03 09:24:09,706 Running migration: 0011_rebuild_errors 2022-04-03 09:24:09,731 Finished: 0011_rebuild_errors 2022-04-03 09:24:09,736 Running migration: 0012_errors_make_level_nullable 2022-04-03 09:24:09,746 Finished: 0012_errors_make_level_nullable 2022-04-03 09:24:09,750 Running migration: 0013_errors_add_hierarchical_hashes 2022-04-03 09:24:09,766 Finished: 0013_errors_add_hierarchical_hashes 2022-04-03 09:24:09,771 Running migration: 0014_backfill_errors 2022-04-03 09:24:09,777 Starting migration from 2022-03-28 2022-04-03 09:24:09,802 Migrated 2022-03-28. (1 of 12 partitions done) 2022-04-03 09:24:09,814 Migrated 2022-03-21. (2 of 12 partitions done) 2022-04-03 09:24:09,825 Migrated 2022-03-14. (3 of 12 partitions done) 2022-04-03 09:24:09,837 Migrated 2022-03-07. (4 of 12 partitions done) 2022-04-03 09:24:09,849 Migrated 2022-02-28. (5 of 12 partitions done) 2022-04-03 09:24:09,861 Migrated 2022-02-21. (6 of 12 partitions done) 2022-04-03 09:24:09,872 Migrated 2022-02-14. (7 of 12 partitions done) 2022-04-03 09:24:09,884 Migrated 2022-02-07. (8 of 12 partitions done) 2022-04-03 09:24:09,896 Migrated 2022-01-31. (9 of 12 partitions done) 2022-04-03 09:24:09,907 Migrated 2022-01-24. (10 of 12 partitions done) 2022-04-03 09:24:09,919 Migrated 2022-01-17. (11 of 12 partitions done) 2022-04-03 09:24:09,932 Migrated 2022-01-10. (12 of 12 partitions done) 2022-04-03 09:24:09,932 Done. Optimizing. 2022-04-03 09:24:09,935 Finished: 0014_backfill_errors 2022-04-03 09:24:09,940 Running migration: 0015_truncate_events 2022-04-03 09:24:09,945 Finished: 0015_truncate_events 2022-04-03 09:24:09,951 Running migration: 0016_drop_legacy_events 2022-04-03 09:24:09,955 Finished: 0016_drop_legacy_events 2022-04-03 09:24:09,960 Running migration: 0001_transactions 2022-04-03 09:24:09,965 Finished: 0001_transactions 2022-04-03 09:24:09,970 Running migration: 0002_transactions_onpremise_fix_orderby_and_partitionby 2022-04-03 09:24:09,976 Finished: 0002_transactions_onpremise_fix_orderby_and_partitionby 2022-04-03 09:24:09,980 Running migration: 0003_transactions_onpremise_fix_columns 2022-04-03 09:24:10,088 Finished: 0003_transactions_onpremise_fix_columns 2022-04-03 09:24:10,093 Running migration: 0004_transactions_add_tags_hash_map 2022-04-03 09:24:10,105 Finished: 0004_transactions_add_tags_hash_map 2022-04-03 09:24:10,111 Running migration: 0005_transactions_add_measurements 2022-04-03 09:24:10,121 Finished: 0005_transactions_add_measurements 2022-04-03 09:24:10,126 Running migration: 0006_transactions_add_http_fields 2022-04-03 09:24:10,142 Finished: 0006_transactions_add_http_fields 2022-04-03 09:24:10,147 Running migration: 0007_transactions_add_discover_cols 2022-04-03 09:24:10,174 Finished: 0007_transactions_add_discover_cols 2022-04-03 09:24:10,178 Running migration: 0008_transactions_add_timestamp_index 2022-04-03 09:24:10,188 Finished: 0008_transactions_add_timestamp_index 2022-04-03 09:24:10,192 Running migration: 0009_transactions_fix_title_and_message 2022-04-03 09:24:10,209 Finished: 0009_transactions_fix_title_and_message 2022-04-03 09:24:10,213 Running migration: 0010_transactions_nullable_trace_id 2022-04-03 09:24:10,222 Finished: 0010_transactions_nullable_trace_id 2022-04-03 09:24:10,226 Running migration: 0011_transactions_add_span_op_breakdowns 2022-04-03 09:24:10,235 Finished: 0011_transactions_add_span_op_breakdowns 2022-04-03 09:24:10,239 Running migration: 0012_transactions_add_spans 2022-04-03 09:24:10,281 Finished: 0012_transactions_add_spans 2022-04-03 09:24:10,285 Running migration: 0013_transactions_reduce_spans_exclusive_time 2022-04-03 09:24:10,303 Finished: 0013_transactions_reduce_spans_exclusive_time 2022-04-03 09:24:10,307 Running migration: 0014_transactions_remove_flattened_columns 2022-04-03 09:24:10,326 Finished: 0014_transactions_remove_flattened_columns 2022-04-03 09:24:10,331 Running migration: 0001_discover_merge_table 2022-04-03 09:24:10,344 Finished: 0001_discover_merge_table 2022-04-03 09:24:10,348 Running migration: 0002_discover_add_deleted_tags_hash_map 2022-04-03 09:24:10,361 Finished: 0002_discover_add_deleted_tags_hash_map 2022-04-03 09:24:10,365 Running migration: 0003_discover_fix_user_column 2022-04-03 09:24:10,373 Finished: 0003_discover_fix_user_column 2022-04-03 09:24:10,378 Running migration: 0004_discover_fix_title_and_message 2022-04-03 09:24:10,391 Finished: 0004_discover_fix_title_and_message 2022-04-03 09:24:10,395 Running migration: 0005_discover_fix_transaction_name 2022-04-03 09:24:10,403 Finished: 0005_discover_fix_transaction_name 2022-04-03 09:24:10,407 Running migration: 0006_discover_add_trace_id 2022-04-03 09:24:10,415 Finished: 0006_discover_add_trace_id 2022-04-03 09:24:10,419 Running migration: 0007_discover_add_span_id 2022-04-03 09:24:10,427 Finished: 0007_discover_add_span_id 2022-04-03 09:24:10,432 Running migration: 0001_outcomes 2022-04-03 09:24:10,437 Finished: 0001_outcomes 2022-04-03 09:24:10,441 Running migration: 0002_outcomes_remove_size_and_bytes 2022-04-03 09:24:10,455 Finished: 0002_outcomes_remove_size_and_bytes 2022-04-03 09:24:10,459 Running migration: 0003_outcomes_add_category_and_quantity 2022-04-03 09:24:10,482 Finished: 0003_outcomes_add_category_and_quantity 2022-04-03 09:24:10,490 Running migration: 0004_outcomes_matview_additions 2022-04-03 09:24:10,500 Finished: 0004_outcomes_matview_additions 2022-04-03 09:24:10,506 Running migration: 0001_metrics_buckets 2022-04-03 09:24:10,514 Finished: 0001_metrics_buckets 2022-04-03 09:24:10,518 Running migration: 0002_metrics_sets 2022-04-03 09:24:10,547 Finished: 0002_metrics_sets 2022-04-03 09:24:10,551 Running migration: 0003_counters_to_buckets 2022-04-03 09:24:10,560 Finished: 0003_counters_to_buckets 2022-04-03 09:24:10,563 Running migration: 0004_metrics_counters 2022-04-03 09:24:10,592 Finished: 0004_metrics_counters 2022-04-03 09:24:10,600 Running migration: 0005_metrics_distributions_buckets 2022-04-03 09:24:10,609 Finished: 0005_metrics_distributions_buckets 2022-04-03 09:24:10,613 Running migration: 0006_metrics_distributions 2022-04-03 09:24:10,647 Finished: 0006_metrics_distributions 2022-04-03 09:24:10,651 Running migration: 0007_metrics_sets_granularity_10 2022-04-03 09:24:10,659 Finished: 0007_metrics_sets_granularity_10 2022-04-03 09:24:10,663 Running migration: 0008_metrics_counters_granularity_10 2022-04-03 09:24:10,670 Finished: 0008_metrics_counters_granularity_10 2022-04-03 09:24:10,674 Running migration: 0009_metrics_distributions_granularity_10 2022-04-03 09:24:10,682 Finished: 0009_metrics_distributions_granularity_10 2022-04-03 09:24:10,685 Running migration: 0010_metrics_sets_granularity_1h 2022-04-03 09:24:10,693 Finished: 0010_metrics_sets_granularity_1h 2022-04-03 09:24:10,697 Running migration: 0011_metrics_counters_granularity_1h 2022-04-03 09:24:10,704 Finished: 0011_metrics_counters_granularity_1h 2022-04-03 09:24:10,708 Running migration: 0012_metrics_distributions_granularity_1h 2022-04-03 09:24:10,716 Finished: 0012_metrics_distributions_granularity_1h 2022-04-03 09:24:10,720 Running migration: 0013_metrics_sets_granularity_1d 2022-04-03 09:24:10,727 Finished: 0013_metrics_sets_granularity_1d 2022-04-03 09:24:10,731 Running migration: 0014_metrics_counters_granularity_1d 2022-04-03 09:24:10,740 Finished: 0014_metrics_counters_granularity_1d 2022-04-03 09:24:10,743 Running migration: 0015_metrics_distributions_granularity_1d 2022-04-03 09:24:10,752 Finished: 0015_metrics_distributions_granularity_1d 2022-04-03 09:24:10,755 Running migration: 0016_metrics_sets_consolidated_granularity 2022-04-03 09:24:10,763 Finished: 0016_metrics_sets_consolidated_granularity 2022-04-03 09:24:10,767 Running migration: 0017_metrics_counters_consolidated_granularity 2022-04-03 09:24:10,775 Finished: 0017_metrics_counters_consolidated_granularity 2022-04-03 09:24:10,779 Running migration: 0018_metrics_distributions_consolidated_granularity 2022-04-03 09:24:10,788 Finished: 0018_metrics_distributions_consolidated_granularity 2022-04-03 09:24:10,792 Running migration: 0019_aggregate_tables_add_ttl 2022-04-03 09:24:10,810 Finished: 0019_aggregate_tables_add_ttl 2022-04-03 09:24:10,815 Running migration: 0020_polymorphic_buckets_table 2022-04-03 09:24:10,824 Finished: 0020_polymorphic_buckets_table 2022-04-03 09:24:10,828 Running migration: 0021_polymorphic_bucket_materialized_views 2022-04-03 09:24:10,844 Finished: 0021_polymorphic_bucket_materialized_views 2022-04-03 09:24:10,849 Running migration: 0022_repartition_polymorphic_table 2022-04-03 09:24:10,863 Finished: 0022_repartition_polymorphic_table 2022-04-03 09:24:10,866 Running migration: 0023_polymorphic_repartitioned_bucket_matview 2022-04-03 09:24:10,885 Finished: 0023_polymorphic_repartitioned_bucket_matview 2022-04-03 09:24:10,889 Running migration: 0024_metrics_distributions_add_histogram 2022-04-03 09:24:10,914 Finished: 0024_metrics_distributions_add_histogram 2022-04-03 09:24:10,919 Running migration: 0025_metrics_counters_aggregate_v2 2022-04-03 09:24:10,944 Finished: 0025_metrics_counters_aggregate_v2 2022-04-03 09:24:10,948 Running migration: 0026_metrics_counters_v2_writing_matview 2022-04-03 09:24:10,952 Finished: 0026_metrics_counters_v2_writing_matview 2022-04-03 09:24:10,956 Running migration: 0027_fix_migration_0026 2022-04-03 09:24:10,966 Finished: 0027_fix_migration_0026 2022-04-03 09:24:10,970 Running migration: 0028_metrics_sets_aggregate_v2 2022-04-03 09:24:10,994 Finished: 0028_metrics_sets_aggregate_v2 2022-04-03 09:24:10,999 Running migration: 0029_metrics_distributions_aggregate_v2 2022-04-03 09:24:11,024 Finished: 0029_metrics_distributions_aggregate_v2 2022-04-03 09:24:11,027 Running migration: 0030_metrics_distributions_v2_writing_mv 2022-04-03 09:24:11,036 Finished: 0030_metrics_distributions_v2_writing_mv 2022-04-03 09:24:11,040 Running migration: 0031_metrics_sets_v2_writing_mv 2022-04-03 09:24:11,048 Finished: 0031_metrics_sets_v2_writing_mv 2022-04-03 09:24:11,051 Running migration: 0032_redo_0030_and_0031_without_timestamps 2022-04-03 09:24:11,066 Finished: 0032_redo_0030_and_0031_without_timestamps 2022-04-03 09:24:11,071 Running migration: 0001_sessions 2022-04-03 09:24:11,077 Finished: 0001_sessions 2022-04-03 09:24:11,081 Running migration: 0002_sessions_aggregates 2022-04-03 09:24:11,133 Finished: 0002_sessions_aggregates 2022-04-03 09:24:11,139 Running migration: 0003_sessions_matview 2022-04-03 09:24:11,151 Finished: 0003_sessions_matview Finished running migrations
▶ Creating additional Kafka topics ...
▶ Ensuring proper PostgreSQL version ...
▶ Setting up / migrating database ... Creating sentry-self-hosted_smtp_1 ... Creating sentry-self-hosted_symbolicator_1 ... Creating sentry-self-hosted_postgres_1 ... Creating sentry-self-hosted_memcached_1 ... Creating sentry-self-hosted_snuba-api_1 ... Creating sentry-self-hosted_snuba-outcomes-consumer_1 ... Creating sentry-self-hosted_snuba-consumer_1 ... Creating sentry-self-hosted_snuba-transactions-consumer_1 ... Creating sentry-self-hosted_snuba-sessions-consumer_1 ... Creating sentry-self-hosted_snuba-replacer_1 ... Creating sentry-self-hosted_snuba-subscription-consumer-events_1 ... Creating sentry-self-hosted_snuba-subscription-consumer-transactions_1 ... Creating sentry-self-hosted_smtp_1 ... done Creating sentry-self-hosted_postgres_1 ... done Creating sentry-self-hosted_memcached_1 ... done Creating sentry-self-hosted_snuba-api_1 ... done Creating sentry-self-hosted_snuba-replacer_1 ... done Creating sentry-self-hosted_snuba-outcomes-consumer_1 ... done Creating sentry-self-hosted_snuba-sessions-consumer_1 ... done Creating sentry-self-hosted_snuba-subscription-consumer-events_1 ... done Creating sentry-self-hosted_symbolicator_1 ... done Creating sentry-self-hosted_snuba-consumer_1 ... done Creating sentry-self-hosted_snuba-subscription-consumer-transactions_1 ... done Creating sentry-self-hosted_snuba-transactions-consumer_1 ... done Creating sentry-self-hosted_web_run ... Creating sentry-self-hosted_web_run ... done Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Installing additional dependencies... WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
!! Configuration error: ConfigurationError("error: argument for 's' must be a bytes object") 1 An error occurred, caught SIGERR on line 12 Cleaning up... root@sentry:/home/ubuntu/onpremise#