search

getsentry / self-hosted

Sentry, feature-complete and packaged up for low-volume deployments and proofs-of-concept
https://develop.sentry.dev/self-hosted/
Other
7.86k stars 1.77k forks source link

Delay before events are visible and emails are received #2419

Closed adpeyre closed 12 months ago

adpeyre commented 1 year ago

Do you have an idea what could be explain this behaviour ?

Self-Hosted Version

23.7.1

CPU Architecture

x86_64

Docker Version

24.0.1, build 6802122

Docker Compose Version

v2.18.1

Steps to Reproduce

I throw an error from my PHP code 2 times.

Expected Result

I should see in the events view the corresponding lines.

I should receive the email immediatly.

Actual Result

The events view indicates "No results found for your query." After some minutes, the events appears. With the "open in discover" view, no result found with a period of 90 days but I can see the events if I set a period of less than 14 days. 255587818-105c81cc-edcf-47fd-aa81-1b1c561ddb0b

The email is received with a delay of 4 minutes.

Event ID

No response

hubertdeng123 commented 1 year ago

This may be due to a latency issue or relay may be taking some time to process the event. Could you check your nginx logs to see the timestamp of when event envelopes are received?

adpeyre commented 1 year ago

I get many errors but I have difficulties to interpret them. Do you see something related to my problem ? Ty logsentry.txt

azaslavsky commented 1 year ago

Sorry, can you paste those logs directly into the issue as text, rather than attaching a file?

adpeyre commented 1 year ago

I've created another instance (not fully configured) in locale and I have the same problem. Interesting somethings ?

sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:34,555 Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd6ff1d7df0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution')': /?load_balancing=in_order&insert_distributed_sync=1&query=INSERT+INTO+default.metrics_raw_v2_local++FORMAT+JSONEachRow
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:36,741 Caught exception, shutting down...
sentry-self-hosted-snuba-metrics-consumer-1                        | Traceback (most recent call last):
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 288, in run
sentry-self-hosted-snuba-metrics-consumer-1                        |     self._run_once()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 368, in _run_once
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__processing_strategy.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/guard.py", line 101, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__inner_strategy.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/run_task.py", line 55, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/guard.py", line 37, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/reduce.py", line 149, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/run_task_in_threads.py", line 107, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     result = future.result()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 437, in result
sentry-self-hosted-snuba-metrics-consumer-1                        |     return self.__get_result()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
sentry-self-hosted-snuba-metrics-consumer-1                        |     raise self._exception
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
sentry-self-hosted-snuba-metrics-consumer-1                        |     result = self.fn(*self.args, **self.kwargs)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/strategy_factory.py", line 122, in flush_batch
sentry-self-hosted-snuba-metrics-consumer-1                        |     message.payload.close()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/consumer.py", line 330, in close
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__insert_batch_writer.close()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/consumer.py", line 160, in close
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__writer.write(
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/clickhouse/http.py", line 347, in write
sentry-self-hosted-snuba-metrics-consumer-1                        |     batch.join(timeout=batch_join_timeout)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/clickhouse/http.py", line 239, in join
sentry-self-hosted-snuba-metrics-consumer-1                        |     response = self._result.result(timeout)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 446, in result
sentry-self-hosted-snuba-metrics-consumer-1                        |     raise TimeoutError()
sentry-self-hosted-snuba-metrics-consumer-1                        | concurrent.futures._base.TimeoutError
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:39,713 Closing <arroyo.backends.kafka.consumer.KafkaConsumer object at 0x7fd6fc5b74f0>...
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:40,028 Partitions to revoke: [Partition(topic=Topic(name='snuba-metrics'), index=0)]
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:40,311 Partition revocation complete.
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:44,826 Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd6ff1f8190>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution')': /?load_balancing=in_order&insert_distributed_sync=1&query=INSERT+INTO+default.metrics_raw_v2_local++FORMAT+JSONEachRow
sentry-self-hosted-snuba-metrics-consumer-1                        | %5|1695979906.082|REQTMOUT|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator/1001: Timed out LeaveGroupRequest in flight (after 5007ms, timeout #0)
sentry-self-hosted-snuba-metrics-consumer-1                        | %4|1695979906.321|REQTMOUT|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator/1001: Timed out 1 in-flight, 0 retry-queued, 0 out-queue, 0 partially-sent requests
sentry-self-hosted-snuba-metrics-consumer-1                        | %3|1695979906.578|FAIL|rdkafka#consumer-3| [thrd:GroupCoordinator]: GroupCoordinator: kafka:9092: 1 request(s) timed out: disconnect (after 1615201ms in state UP)
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:46,693 Error callback from librdKafka -185, _TIMED_OUT, GroupCoordinator: kafka:9092: 1 request(s) timed out: disconnect (after 1615201ms in state UP)
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:47,611 Processor terminated
sentry-self-hosted-snuba-metrics-consumer-1                        | Traceback (most recent call last):
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/bin/snuba", line 33, in <module>
sentry-self-hosted-snuba-metrics-consumer-1                        |     sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1130, in __call__
sentry-self-hosted-snuba-metrics-consumer-1                        |     return self.main(*args, **kwargs)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1055, in main
sentry-self-hosted-snuba-metrics-consumer-1                        |     rv = self.invoke(ctx)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1657, in invoke
sentry-self-hosted-snuba-metrics-consumer-1                        |     return _process_result(sub_ctx.command.invoke(sub_ctx))
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1404, in invoke
sentry-self-hosted-snuba-metrics-consumer-1                        |     return ctx.invoke(self.callback, **ctx.params)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/click/core.py", line 760, in invoke
sentry-self-hosted-snuba-metrics-consumer-1                        |     return __callback(*args, **kwargs)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/cli/consumer.py", line 269, in consumer
sentry-self-hosted-snuba-metrics-consumer-1                        |     consumer.run()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 288, in run
sentry-self-hosted-snuba-metrics-consumer-1                        |     self._run_once()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 368, in _run_once
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__processing_strategy.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/guard.py", line 101, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__inner_strategy.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/run_task.py", line 55, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/guard.py", line 37, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/reduce.py", line 149, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__next_step.poll()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/run_task_in_threads.py", line 107, in poll
sentry-self-hosted-snuba-metrics-consumer-1                        |     result = future.result()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 437, in result
sentry-self-hosted-snuba-metrics-consumer-1                        |     return self.__get_result()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
sentry-self-hosted-snuba-metrics-consumer-1                        |     raise self._exception
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/thread.py", line 57, in run
sentry-self-hosted-snuba-metrics-consumer-1                        |     result = self.fn(*self.args, **self.kwargs)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/strategy_factory.py", line 122, in flush_batch
sentry-self-hosted-snuba-metrics-consumer-1                        |     message.payload.close()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/consumer.py", line 330, in close
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__insert_batch_writer.close()
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/consumers/consumer.py", line 160, in close
sentry-self-hosted-snuba-metrics-consumer-1                        |     self.__writer.write(
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/clickhouse/http.py", line 347, in write
sentry-self-hosted-snuba-metrics-consumer-1                        |     batch.join(timeout=batch_join_timeout)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/src/snuba/snuba/clickhouse/http.py", line 239, in join
sentry-self-hosted-snuba-metrics-consumer-1                        |     response = self._result.result(timeout)
sentry-self-hosted-snuba-metrics-consumer-1                        |   File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 446, in result
sentry-self-hosted-snuba-metrics-consumer-1                        | 2023-09-29 09:31:57,861 Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fd6fc5b7910>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution')': /?load_balancing=in_order&insert_distributed_sync=1&query=INSERT+INTO+default.metrics_raw_v2_local++FORMAT+JSONEachRow
sentry-self-hosted-snuba-metrics-consumer-1                        |     raise TimeoutError()
sentry-self-hosted-snuba-metrics-consumer-1                        | concurrent.futures._base.TimeoutError
sentry-self-hosted-kafka-1                                         | [2023-09-29 09:31:17,240] WARN Client session timed out, have not heard from server in 12043ms for sessionid 0x100003dc5af0001 (org.apache.zookeeper.ClientCnxn)
sentry-self-hosted-kafka-1                                         | [2023-09-29 09:32:11,450] ERROR Unable to resolve address: zookeeper:2181 (org.apache.zookeeper.client.StaticHostProvider)
sentry-self-hosted-kafka-1                                         | java.net.UnknownHostException: zookeeper: Temporary failure in name resolution
sentry-self-hosted-kafka-1                                         |    at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method)
sentry-self-hosted-kafka-1                                         |    at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:929)
sentry-self-hosted-kafka-1                                         |    at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1324)
sentry-self-hosted-kafka-1                                         |    at java.net.InetAddress.getAllByName0(InetAddress.java:1277)
sentry-self-hosted-kafka-1                                         |    at java.net.InetAddress.getAllByName(InetAddress.java:1193)
sentry-self-hosted-kafka-1                                         |    at java.net.InetAddress.getAllByName(InetAddress.java:1127)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.client.StaticHostProvider$1.getAllByName(StaticHostProvider.java:92)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.client.StaticHostProvider.resolve(StaticHostProvider.java:147)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:375)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1137)
sentry-self-hosted-kafka-1                                         | [2023-09-29 09:32:11,888] WARN Session 0x100003dc5af0001 for server zookeeper:2181, unexpected error, closing socket connection and attempting reconnect (org.apache.zookeeper.ClientCnxn)
sentry-self-hosted-kafka-1                                         | java.lang.IllegalArgumentException: Unable to canonicalize address zookeeper:2181 because it's not resolvable
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:71)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.SaslServerPrincipal.getServerPrincipal(SaslServerPrincipal.java:39)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1087)
sentry-self-hosted-kafka-1                                         |    at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1139)
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:30:50 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options[8b545ee1-f73a-4de9-aae6-091f57a86f8a] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '8b545ee1-f73a-4de9-aae6-091f57a86f8a', 'name': 'sentry.tasks.options.sync_options', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:30:50 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options_control[dfe3ad77-77be-4fe2-9ee6-92d9b9509e35] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': 'dfe3ad77-77be-4fe2-9ee6-92d9b9509e35', 'name': 'sentry.tasks.options.sync_options_control', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:31:18 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options_control[e4686c2b-b55f-4c9c-ad4a-143a31745794] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': 'e4686c2b-b55f-4c9c-ad4a-143a31745794', 'name': 'sentry.tasks.options.sync_options_control', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:31:19 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options[eaec00d7-7fb8-460e-8966-88b76ab14b1b] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': 'eaec00d7-7fb8-460e-8966-88b76ab14b1b', 'name': 'sentry.tasks.options.sync_options', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:31:28 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options[9f9d9f22-c127-4d60-92c2-c2a5a5cc748d] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '9f9d9f22-c127-4d60-92c2-c2a5a5cc748d', 'name': 'sentry.tasks.options.sync_options', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:31:29 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options_control[810c2ba3-620e-42ac-9eb9-50aa71b486f1] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '810c2ba3-620e-42ac-9eb9-50aa71b486f1', 'name': 'sentry.tasks.options.sync_options_control', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/p09:32:10 [INFO] sentry_sdk.errors: event processor (<function DedupeIntegration.setup_once.<locals>.processor at 0x7fdd2045e1f0>) dropped event
sentry-self-hosted-worker-1                                        | 09:32:10 [INFO] sentry_sdk.errors: event processor (<function DedupeIntegration.setup_once.<locals>.processor at 0x7fdd2045e1f0>) dropped event
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()ython3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/recap_servers.py", line 50, in poll_recap_servers
sentry-self-hosted-worker-1                                        |     for project_id in project_ids:
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 280, in __iter__
sentry-self-hosted-worker-1                                        |     self._fetch_all()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 1324, in _fetch_all
sentry-self-hosted-worker-1                                        |     self._result_cache = list(self._iterable_class(self))
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 171, in __iter__
sentry-self-hosted-worker-1                                        |     for row in compiler.results_iter(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1130, in results_iter
sentry-self-hosted-worker-1                                        |     results = self.execute_sql(MULTI, chunked_fetch=chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor
sentry-self-hosted-worker-1                                        |     return self._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:01,813 Partitions to revoke: [Partition(topic=Topic(name='events'), index=0)]
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:02,071 Closing <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f11784a18e0>...
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:02,095 Waiting for <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f11784a18e0> to exit...
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:02,108 <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f11784a18e0> exited successfully, releasing assignment.
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:02,114 Partition revocation complete.
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-snuba-consumer-1                                | 2023-09-29 09:32:11,214 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2}
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 27, in enqueue_outbox_jobs_control
sentry-self-hosted-worker-1                                        |     schedule_batch(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 68, in schedule_batch
sentry-self-hosted-worker-1                                        |     lo = outbox_model.objects.all().aggregate(Min("id"))["id__min"] or 0
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 399, in aggregate
sentry-self-hosted-worker-1                                        |     return query.get_aggregation(self.db, kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/query.py", line 513, in get_aggregation
sentry-self-hosted-worker-1                                        |     result = compiler.execute_sql(SINGLE)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor
sentry-self-hosted-worker-1                                        |     return self._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:32:11 [ERROR] celery.app.trace: Task sentry.tasks.poll_recap_servers[2371a41d-ab79-4bbb-8c8f-d38863370f23] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '2371a41d-ab79-4bbb-8c8f-d38863370f23', 'name': 'sentry.tasks.poll_recap_servers', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/recap_servers.py", line 50, in poll_recap_servers\n    for project_id in project_ids:\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 280, in __iter__\n    self._fetch_all()\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 1324, in _fetch_all\n    self._result_cache = list(self._iterable_class(self))\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 171, in __iter__\n    for row in compiler.results_iter(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size):\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1130, in results_iter\n    results = self.execute_sql(MULTI, chunked_fetch=chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql\n    cursor = self.connection.cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor\n    return self._cursor()\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | 09:32:11 [ERROR] celery.app.trace: Task sentry.tasks.enqueue_outbox_jobs_control[134b7602-0aad-4012-a3aa-2d659784a1fe] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '134b7602-0aad-4012-a3aa-2d659784a1fe', 'name': 'sentry.tasks.enqueue_outbox_jobs_control', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 27, in enqueue_outbox_jobs_control\n    schedule_batch(\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 68, in schedule_batch\n    lo = outbox_model.objects.all().aggregate(Min("id"))["id__min"] or 0\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 399, in aggregate\n    return query.get_aggregation(self.db, kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/query.py", line 513, in get_aggregation\n    result = compiler.execute_sql(SINGLE)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql\n    cursor = self.connection.cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor\n    return self._cursor()\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
entry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 37, in enqueue_outbox_jobs
sentry-self-hosted-worker-1                                        |     schedule_batch(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 68, in schedule_batch
sentry-self-hosted-worker-1                                        |     lo = outbox_model.objects.all().aggregate(Min("id"))["id__min"] or 0
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 399, in aggregate
sentry-self-hosted-worker-1                                        |     return query.get_aggregation(self.db, kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/query.py", line 513, in get_aggregation
sentry-self-hosted-worker-1                                        |     result = compiler.execute_sql(SINGLE)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor
sentry-self-hosted-worker-1                                        |     return self._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:32:11 [ERROR] celery.app.trace: Task sentry.tasks.enqueue_outbox_jobs[68efee68-5b65-406e-bd5a-b43d57449328] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '68efee68-5b65-406e-bd5a-b43d57449328', 'name': 'sentry.tasks.enqueue_outbox_jobs', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 37, in enqueue_outbox_jobs\n    schedule_batch(\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/deliver_from_outbox.py", line 68, in schedule_batch\n    lo = outbox_model.objects.all().aggregate(Min("id"))["id__min"] or 0\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 399, in aggregate\n    return query.get_aggregation(self.db, kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/query.py", line 513, in get_aggregation\n    result = compiler.execute_sql(SINGLE)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql\n    cursor = self.connection.cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor\n    return self._cursor()\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-worker-1                                        | 09:31:52 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options[9be864d2-c436-448d-b3ca-f80eb9406e8b] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '9be864d2-c436-448d-b3ca-f80eb9406e8b', 'name': 'sentry.tasks.options.sync_options', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:02,205 Partitions to revoke: [Partition(topic=Topic(name='profiles-call-tree'), index=0)]
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:02,464 Closing <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f1ba5b660d0>...
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:02,486 Waiting for <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f1ba5b660d0> to exit...
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:02,593 <arroyo.processing.strategies.guard.StrategyGuard object at 0x7f1ba5b660d0> exited successfully, releasing assignment.
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:03,218 Partition revocation complete.
sentry-self-hosted-snuba-profiling-functions-consumer-1            | 2023-09-29 09:32:11,229 New partitions assigned: {Partition(topic=Topic(name='profiles-call-tree'), index=0): 0}
sentry-self-hosted-web-1                                           | Traceback (most recent call last):
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-web-1                                           |     self.connect()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-web-1                                           |     return real_connect(self)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-web-1                                           |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-web-1                                           |     connection = Database.connect(**conn_params)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-web-1                                           |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-web-1                                           | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-web-1                                           |
sentry-self-hosted-web-1                                           |
sentry-self-hosted-web-1                                           | The above exception was the direct cause of the following exception:
sentry-self-hosted-web-1                                           |
sentry-self-hosted-web-1                                           | Traceback (most recent call last):
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/api/base.py", line 250, in handle_exception
sentry-self-hosted-web-1                                           |     response = super().handle_exception(exc)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/views.py", line 469, in handle_exception
sentry-self-hosted-web-1                                           |     self.raise_uncaught_exception(exc)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/views.py", line 480, in raise_uncaught_exception
sentry-self-hosted-web-1                                           |     raise exc
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/api/base.py", line 351, in dispatch
sentry-self-hosted-web-1                                           |     self.initial(request, *args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../sentry_sdk/integrations/django/__init__.py", line 303, in sentry_patched_drf_initial
sentry-self-hosted-web-1                                           |     return old_drf_initial(self, request, *args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/views.py", line 414, in initial
sentry-self-hosted-web-1                                           |     self.perform_authentication(request)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/views.py", line 324, in perform_authentication
sentry-self-hosted-web-1                                           |     request.user
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/request.py", line 227, in user
sentry-self-hosted-web-1                                           |     self._authenticate()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../rest_framework/request.py", line 380, in _authenticate
sentry-self-hosted-web-1                                           |     user_auth_tuple = authenticator.authenticate(self)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/api/authentication.py", line 163, in authenticate
sentry-self-hosted-web-1                                           |     return self.authenticate_credentials(relay_id, relay_sig, request)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/api/authentication.py", line 169, in authenticate_credentials
sentry-self-hosted-web-1                                           |     relay, static = relay_from_id(request, relay_id)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/api/authentication.py", line 117, in relay_from_id
sentry-self-hosted-web-1                                           |     relay = Relay.objects.get(relay_id=relay_id)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/db/models/manager/base.py", line 260, in get
sentry-self-hosted-web-1                                           |     return super().get(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/manager.py", line 85, in manager_method
sentry-self-hosted-web-1                                           |     return getattr(self.get_queryset(), name)(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 431, in get
sentry-self-hosted-web-1                                           |     num = len(clone)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 262, in __len__
sentry-self-hosted-web-1                                           |     self._fetch_all()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 1324, in _fetch_all
sentry-self-hosted-web-1                                           |     self._result_cache = list(self._iterable_class(self))
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-web-1                                           |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1173, in execute_sql
sentry-self-hosted-web-1                                           |     cursor = self.connection.cursor()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 259, in cursor
sentry-self-hosted-web-1                                           |     return self._cursor()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-web-1                                           |     return func(self, *args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-web-1                                           |     return super()._cursor()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-web-1                                           |     self.ensure_connection()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-web-1                                           |     self.connect()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-web-1                                           |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-web-1                                           |     self.connect()
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-web-1                                           |     return real_connect(self)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-web-1                                           |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-web-1                                           |     return func(*args, **kwargs)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-web-1                                           |     connection = Database.connect(**conn_params)
sentry-self-hosted-web-1                                           |   File "/usr/local/lib/python3.8/site-packages/sentry/../psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-web-1                                           |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-web-1                                           | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-web-1                                           |
sentry-self-hosted-web-1                                           | 09:30:50 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.relay.health_check.RelayHealthCheck' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/relays/live/' caller_ip='172.19.0.51' user_agent='None' rate_limited='False' rate_limit_category='None' request_duration_seconds=11.377204656600952 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
sentry-self-hosted-web-1                                           | 09:31:09 [INFO] sentry.access.api: api.access (method='GET' view='sentry.api.endpoints.relay.health_check.RelayHealthCheck' response=200 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/relays/live/' caller_ip='172.19.0.51' user_agent='None' rate_limited='False' rate_limit_category='None' request_duration_seconds=22.27744746208191 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:32:13 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options[8c17e535-6f1b-474e-a906-1b3937f82748] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': '8c17e535-6f1b-474e-a906-1b3937f82748', 'name': 'sentry.tasks.options.sync_options', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 26, in sync_options\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-web-1                                           | 09:32:13 [INFO] sentry.access.api: api.access (method='POST' view='sentry.api.endpoints.relay.project_configs.RelayProjectConfigsEndpoint' response=500 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/relays/projectconfigs/' caller_ip='172.19.0.51' user_agent='None' rate_limited='False' rate_limit_category='None' request_duration_seconds=101.01498365402222 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
sentry-self-hosted-web-1                                           | 09:32:13 [ERROR] django.request: Internal Server Error: /api/0/relays/projectconfigs/ (status_code=500 request=<WSGIRequest: POST '/api/0/relays/projectconfigs/?version=3'>)
sentry-self-hosted-web-1                                           | 09:32:13 [INFO] sentry.access.api: api.access (method='POST' view='sentry.api.endpoints.relay.project_configs.RelayProjectConfigsEndpoint' response=500 user_id='None' is_app='None' token_type='None' is_frontend_request='False' organization_id='None' auth_id='None' path='/api/0/relays/projectconfigs/' caller_ip='172.19.0.51' user_agent='None' rate_limited='False' rate_limit_category='None' request_duration_seconds=116.91304326057434 rate_limit_type='DNE' concurrent_limit='None' concurrent_requests='None' reset_time='None' group='None' limit='None' remaining='None')
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | psycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | The above exception was the direct cause of the following exception:
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | Traceback (most recent call last):
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task
sentry-self-hosted-worker-1                                        |     R = retval = fun(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner
sentry-self-hosted-worker-1                                        |     reraise(*exc_info)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise
sentry-self-hosted-worker-1                                        |     raise value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner
sentry-self-hosted-worker-1                                        |     return f(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__
sentry-self-hosted-worker-1                                        |     return self.run(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override
sentry-self-hosted-worker-1                                        |     return original_method(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped
sentry-self-hosted-worker-1                                        |     result = func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control
sentry-self-hosted-worker-1                                        |     _sync_options(cutoff)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options
sentry-self-hosted-worker-1                                        |     for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator
sentry-self-hosted-worker-1                                        |     yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__
sentry-self-hosted-worker-1                                        |     results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql
sentry-self-hosted-worker-1                                        |     cursor = self.connection.chunked_cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor
sentry-self-hosted-worker-1                                        |     return self._cursor(
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner
sentry-self-hosted-worker-1                                        |     return func(self, *args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor
sentry-self-hosted-worker-1                                        |     return super()._cursor()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor
sentry-self-hosted-worker-1                                        |     self.ensure_connection()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__
sentry-self-hosted-worker-1                                        |     raise dj_exc_value.with_traceback(traceback) from exc_value
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection
sentry-self-hosted-worker-1                                        |     self.connect()
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect
sentry-self-hosted-worker-1                                        |     return real_connect(self)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect
sentry-self-hosted-worker-1                                        |     self.connection = self.get_new_connection(conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner
sentry-self-hosted-worker-1                                        |     return func(*args, **kwargs)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection
sentry-self-hosted-worker-1                                        |     connection = Database.connect(**conn_params)
sentry-self-hosted-worker-1                                        |   File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect
sentry-self-hosted-worker-1                                        |     conn = _connect(dsn, connection_factory=connection_factory, **kwasync)
sentry-self-hosted-worker-1                                        | django.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution
sentry-self-hosted-worker-1                                        |
sentry-self-hosted-worker-1                                        | 09:32:13 [ERROR] celery.app.trace: Task sentry.tasks.options.sync_options_control[bacd1de1-5670-4bf9-aada-6d5101337892] raised unexpected: OperationalError('could not translate host name "postgres" to address: Temporary failure in name resolution\n') (data={'hostname': 'db374847d301', 'id': 'bacd1de1-5670-4bf9-aada-6d5101337892', 'name': 'sentry.tasks.options.sync_options_control', 'exc': 'OperationalError(\'could not translate host name "postgres" to address: Temporary failure in name resolution\\n\')', 'traceback': 'Traceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\npsycopg2.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n\nThe above exception was the direct cause of the following exception:\n\nTraceback (most recent call last):\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 412, in trace_task\n    R = retval = fun(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 280, in _inner\n    reraise(*exc_info)\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/_compat.py", line 99, in reraise\n    raise value\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/celery.py", line 275, in _inner\n    return f(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/celery/app/trace.py", line 704, in __protected_call__\n    return self.run(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/silo/base.py", line 160, in override\n    return original_method(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/base.py", line 126, in _wrapped\n    result = func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 21, in sync_options_control\n    _sync_options(cutoff)\n  File "/usr/local/lib/python3.8/site-packages/sentry/tasks/options.py", line 39, in _sync_options\n    for option in default_store.model.objects.filter(last_updated__gte=cutoff_dt).iterator():\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 353, in _iterator\n    yield from self._iterable_class(self, chunked_fetch=use_chunked_fetch, chunk_size=chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/query.py", line 51, in __iter__\n    results = compiler.execute_sql(chunked_fetch=self.chunked_fetch, chunk_size=self.chunk_size)\n  File "/usr/local/lib/python3.8/site-packages/django/db/models/sql/compiler.py", line 1171, in execute_sql\n    cursor = self.connection.chunked_cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 266, in chunked_cursor\n    return self._cursor(\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/decorators.py", line 40, in inner\n    return func(self, *args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/sentry/db/postgres/base.py", line 110, in _cursor\n    return super()._cursor()\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 235, in _cursor\n    self.ensure_connection()\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/django/db/utils.py", line 90, in __exit__\n    raise dj_exc_value.with_traceback(traceback) from exc_value\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 219, in ensure_connection\n    self.connect()\n  File "/usr/local/lib/python3.8/site-packages/sentry_sdk/integrations/django/__init__.py", line 641, in connect\n    return real_connect(self)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/base/base.py", line 200, in connect\n    self.connection = self.get_new_connection(conn_params)\n  File "/usr/local/lib/python3.8/site-packages/django/utils/asyncio.py", line 33, in inner\n    return func(*args, **kwargs)\n  File "/usr/local/lib/python3.8/site-packages/django/db/backends/postgresql/base.py", line 187, in get_new_connection\n    connection = Database.connect(**conn_params)\n  File "/usr/local/lib/python3.8/site-packages/psycopg2/__init__.py", line 127, in connect\n    conn = _connect(dsn, connection_factory=connection_factory, **kwasync)\ndjango.db.utils.OperationalError: could not translate host name "postgres" to address: Temporary failure in name resolution\n\n', 'args': '()', 'kwargs': '{}', 'description': 'raised unexpected', 'internal': False})
sentry-self-hosted-web-1                                           | 09:32:13 [ERROR] django.request: Internal Server Error: /api/0/relays/projectconfigs/ (status_code=500 request=<WSGIRequest: POST '/api/0/relays/projectconfigs/?version=3'>)
sentry-self-hosted-kafka-1                                         | [2023-09-29 09:32:13,694] WARN Unable to reconnect to ZooKeeper service, session 0x100003dc5af0001 has expired (org.apache.zookeeper.ClientCnxn)
azaslavsky commented 1 year ago

It may be worthwhile to restart with docker down followed by docker up -d. Beyond that, I'm not sure that these two things (the temporary errors you are seeing, and the observed behavior) are related.

getsantry[bot] commented 1 year ago

This issue has gone three weeks without activity. In another week, I will close it.

But! If you comment or otherwise update it, I will reset the clock, and if you remove the label Waiting for: Community, I will leave it alone ... forever!

"A weed is but an unloved flower." ― Ella Wheeler Wilcox 🥀