search

getsentry / self-hosted

Sentry, feature-complete and packaged up for low-volume deployments and proofs-of-concept
https://develop.sentry.dev/self-hosted/
Other
7.74k stars 1.75k forks source link

Session Replay recordings are not visible in Sentry web #2817

Closed hostinqer closed 6 months ago

hostinqer commented 6 months ago

Self-Hosted Version

23.11.1

CPU Architecture

x86_64

Docker Version

24.0.7

Docker Compose Version

v2.18.1

Steps to Reproduce

add project all working. I get Session Replay, but nothing is visible as a video, as a player. But the requests are coming in.

Снимок экрана от 2024-02-21 17-00-09 Снимок экрана от 2024-02-21 17-01-15 Снимок экрана от 2024-02-21 17-23-41

Expected Result

I get issues, but not visible.

Actual Result

ls -1 sentry_install_log-*.txt | tail -1 | xargs cat ▶ Parsing command line ...

▶ Detecting Docker platform Detected Docker platform is linux/amd64

▶ Initializing Docker Compose ...

▶ Setting up error handling ...

0 building with "default" instance using docker driver

1 [internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [internal] load build definition from Dockerfile

2 transferring dockerfile: 292B done

2 DONE 0.0s

3 [internal] load metadata for docker.io/library/debian:bookworm-slim

3 DONE 0.8s

4 [1/2] FROM docker.io/library/debian:bookworm-slim@sha256:f80c45482c8d147da87613cb6878a7238b8642bcc24fc11bad78c7bec726f340

4 DONE 0.0s

5 [2/2] RUN set -x && apt-get update && DEBIAN_FRONTEND=noninteractive apt-get install -y --no-install-recommends jq && apt-get clean && rm -rf /var/lib/apt/lists/*

5 CACHED

6 exporting to image

6 exporting layers done

6 writing image sha256:68d7bd1696b0b71433671653a0966c2bb31e8dc9c6fbe3df10ea855f66e51778 done

6 naming to docker.io/library/sentry-self-hosted-jq-local done

6 DONE 0.0s

Hey, so ... we would love to automatically find out about issues with your Sentry instance so that we can improve the product. Turns out there is an app for that, called Sentry. Would you be willing to let us automatically send data about your instance upstream to Sentry for development and debugging purposes?

y / yes / 1 n / no / 0

(Btw, we send this to our own self-hosted Sentry instance, not to Sentry SaaS, so that we can be in this together.)

Here's the info we may collect:

Thirty (30) day retention. No marketing. Privacy policy at sentry.io/privacy.

y or n? Understood. To avoid this prompt in the future, use one of these flags:

--report-self-hosted-issues --no-report-self-hosted-issues

or set the REPORT_SELF_HOSTED_ISSUES environment variable:

REPORT_SELF_HOSTED_ISSUES=1 to send data REPORT_SELF_HOSTED_ISSUES=0 to not send data

▶ Checking for latest commit ... skipped

▶ Checking minimum requirements ... Found Docker version 24.0.7 Found Docker Compose version 2.21.0

▶ Turning things off ... Container sentry-self-hosted-symbolicator-1 Stopping Container sentry-self-hosted-postgres-1 Stopping Container sentry-self-hosted-snuba-replacer-1 Stopping Container sentry-self-hosted-snuba-transactions-consumer-1 Stopping Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Stopping Container sentry-self-hosted-smtp-1 Stopping Container sentry-self-hosted-memcached-1 Stopping Container sentry-self-hosted-snuba-subscription-consumer-events-1 Stopping Container sentry-self-hosted-vroom-1 Stopping Container sentry-self-hosted-snuba-outcomes-consumer-1 Stopping Container sentry-self-hosted-snuba-consumer-1 Stopping Container sentry-self-hosted-snuba-api-1 Stopping Container sentry-self-hosted-symbolicator-1 Stopped Container sentry-self-hosted-symbolicator-1 Removing Container sentry-self-hosted-postgres-1 Stopped Container sentry-self-hosted-postgres-1 Removing Container sentry-self-hosted-snuba-replacer-1 Stopped Container sentry-self-hosted-snuba-replacer-1 Removing Container sentry-self-hosted-snuba-outcomes-consumer-1 Stopped Container sentry-self-hosted-snuba-outcomes-consumer-1 Removing Container sentry-self-hosted-memcached-1 Stopped Container sentry-self-hosted-memcached-1 Removing Container sentry-self-hosted-snuba-transactions-consumer-1 Stopped Container sentry-self-hosted-snuba-transactions-consumer-1 Removing Container sentry-self-hosted-snuba-consumer-1 Stopped Container sentry-self-hosted-snuba-consumer-1 Removing Container sentry-self-hosted-snuba-api-1 Stopped Container sentry-self-hosted-snuba-api-1 Removing Container sentry-self-hosted-vroom-1 Stopped Container sentry-self-hosted-vroom-1 Removing Container sentry-self-hosted-smtp-1 Stopped Container sentry-self-hosted-smtp-1 Removing Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Stopped Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Removing Container sentry-self-hosted-snuba-subscription-consumer-events-1 Stopped Container sentry-self-hosted-snuba-subscription-consumer-events-1 Removing Container sentry-self-hosted-snuba-api-1 Removed Container sentry-self-hosted-symbolicator-1 Removed Container sentry-self-hosted-snuba-transactions-consumer-1 Removed Container sentry-self-hosted-snuba-subscription-consumer-events-1 Removed Container sentry-self-hosted-snuba-outcomes-consumer-1 Removed Container sentry-self-hosted-memcached-1 Removed Container sentry-self-hosted-vroom-1 Removed Container sentry-self-hosted-postgres-1 Removed Container sentry-self-hosted-snuba-consumer-1 Removed Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Removed Container sentry-self-hosted-snuba-replacer-1 Removed Container sentry-self-hosted-redis-1 Stopping Container sentry-self-hosted-clickhouse-1 Stopping Container sentry-self-hosted-kafka-1 Stopping Container sentry-self-hosted-redis-1 Stopped Container sentry-self-hosted-redis-1 Removing Container sentry-self-hosted-clickhouse-1 Stopped Container sentry-self-hosted-clickhouse-1 Removing Container sentry-self-hosted-kafka-1 Stopped Container sentry-self-hosted-kafka-1 Removing Container sentry-self-hosted-smtp-1 Removed Container sentry-self-hosted-redis-1 Removed Container sentry-self-hosted-clickhouse-1 Removed Container sentry-self-hosted-kafka-1 Removed Container sentry-self-hosted-zookeeper-1 Stopping Container sentry-self-hosted-zookeeper-1 Stopped Container sentry-self-hosted-zookeeper-1 Removing Container sentry-self-hosted-zookeeper-1 Removed Image vroom-cleanup-self-hosted-local:latest Removing Image sentry-cleanup-self-hosted-local:latest Removing Image clickhouse-self-hosted-local:latest Removing Image symbolicator-cleanup-self-hosted-local:latest Removing Image sentry-self-hosted-local:latest Removing Network sentry-self-hosted_default Removing Image clickhouse-self-hosted-local:latest Removed Image vroom-cleanup-self-hosted-local:latest Removed Image sentry-self-hosted-local:latest Removed Image sentry-cleanup-self-hosted-local:latest Removed Image symbolicator-cleanup-self-hosted-local:latest Removed Network sentry-self-hosted_default Removed

▶ Creating volumes for persistent storage ... Created sentry-clickhouse. Created sentry-data. Created sentry-kafka. Created sentry-postgres. Created sentry-redis. Created sentry-symbolicator. Created sentry-zookeeper.

▶ Ensuring files from examples ... sentry/sentry.conf.py already exists, skipped creation. sentry/config.yml already exists, skipped creation. symbolicator/config.yml already exists, skipped creation.

▶ Ensuring Relay credentials ... relay/config.yml already exists, skipped creation. relay/credentials.json already exists, skipped creation.

▶ Generating secret key ...

▶ Fetching and updating Docker images ... 23.11.1: Pulling from getsentry/sentry b7f91549542c: Already exists 5da3ecefe565: Already exists 9c618414dafd: Already exists 1526ace3d91f: Already exists cab43b4c210f: Already exists b2d823ab7ab6: Already exists 95c92684ceb6: Already exists a344107143b7: Pulling fs layer 87489dc0a227: Pulling fs layer 6f412d4e1627: Pulling fs layer 8174deb9d088: Pulling fs layer dac59dd62fe2: Pulling fs layer 7784df623010: Pulling fs layer 9a269a47baf2: Pulling fs layer 4e1d0544792b: Pulling fs layer 8174deb9d088: Waiting dac59dd62fe2: Waiting 7784df623010: Waiting 9a269a47baf2: Waiting 4e1d0544792b: Waiting a344107143b7: Download complete a344107143b7: Pull complete 6f412d4e1627: Verifying Checksum 6f412d4e1627: Download complete 8174deb9d088: Verifying Checksum 8174deb9d088: Download complete 7784df623010: Download complete dac59dd62fe2: Download complete 9a269a47baf2: Verifying Checksum 9a269a47baf2: Download complete 4e1d0544792b: Verifying Checksum 4e1d0544792b: Download complete 87489dc0a227: Verifying Checksum 87489dc0a227: Download complete 87489dc0a227: Pull complete 6f412d4e1627: Pull complete 8174deb9d088: Pull complete dac59dd62fe2: Pull complete 7784df623010: Pull complete 9a269a47baf2: Pull complete 4e1d0544792b: Pull complete Digest: sha256:ec9f6323d10d2d90baa353de5fd397318fdfeca5d0b31bdc78150a85f930763e Status: Downloaded newer image for getsentry/sentry:23.11.1 docker.io/getsentry/sentry:23.11.1

▶ Building and tagging Docker images ...

0 building with "default" instance using docker driver

1 [web internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [web internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [web internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [web internal] load build context

4 transferring context: 297B done

4 DONE 0.0s

5 [web 1/4] FROM docker.io/getsentry/sentry:23.11.1

5 DONE 0.1s

6 [web 2/4] COPY . /usr/src/sentry

6 DONE 0.0s

7 [web 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 DONE 0.2s

8 [web 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 DONE 0.3s

9 [web] exporting to image

9 exporting layers 0.0s done

9 writing image sha256:12a7123827a0aea9b665fa4e1a61ed04aff1712e1ac8203fd755021a3b7e9727 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [clickhouse internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [clickhouse internal] load build definition from Dockerfile

2 transferring dockerfile: 71B done

2 DONE 0.0s

3 [clickhouse internal] load metadata for docker.io/altinity/clickhouse-server:21.8.13.1.altinitystable

3 DONE 0.3s

4 [clickhouse 1/1] FROM docker.io/altinity/clickhouse-server:21.8.13.1.altinitystable@sha256:125d2ea49c298515c46784d202a2bd4dde05157c85a76517afc2567f262ab335

4 CACHED

5 [clickhouse] exporting to image

5 exporting layers done

5 writing image sha256:dee2d6049567e60691afce68ee63c6223330fd14cde01751502e035f521d6761 done

5 naming to docker.io/library/clickhouse-self-hosted-local done

5 DONE 0.0s

0 building with "default" instance using docker driver

1 [attachments-consumer internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [attachments-consumer internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [attachments-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [attachments-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [attachments-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [attachments-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [attachments-consumer 2/4] COPY . /usr/src/sentry

7 CACHED

8 [attachments-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [attachments-consumer] exporting to image

9 exporting layers done

9 writing image sha256:3f869db71f97cf62ec20ba8860dff644263d76ad8eebb1c8c0e101588ab91f37 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [billing-metrics-consumer internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [billing-metrics-consumer internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [billing-metrics-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [billing-metrics-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [billing-metrics-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [billing-metrics-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [billing-metrics-consumer 2/4] COPY . /usr/src/sentry

7 CACHED

8 [billing-metrics-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [billing-metrics-consumer] exporting to image

9 exporting layers done

9 writing image sha256:faa45b1b26371c891dc415450549761957e52183ee9f3ffe979fa093ce731ace done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [cron internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [cron internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [cron internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [cron 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [cron internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [cron 2/4] COPY . /usr/src/sentry

6 CACHED

7 [cron 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [cron 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [cron] exporting to image

9 exporting layers done

9 writing image sha256:5b2ffdbd3a3f28c1dd47ae54ed24d512e391125290efb26182158eec6c01299e done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [events-consumer internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [events-consumer internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [events-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [events-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [events-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [events-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [events-consumer 2/4] COPY . /usr/src/sentry

7 CACHED

8 [events-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [events-consumer] exporting to image

9 exporting layers done

9 writing image sha256:7981a861e890c50ee9af6a7083f6b427b5a0ada84aa31d917b3d317721827fa7 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [generic-metrics-consumer internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [generic-metrics-consumer internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [generic-metrics-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [generic-metrics-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [generic-metrics-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [generic-metrics-consumer 2/4] COPY . /usr/src/sentry

6 CACHED

7 [generic-metrics-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [generic-metrics-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [generic-metrics-consumer] exporting to image

9 exporting layers done

9 writing image sha256:7a6f17dbc52cfa0a2ca47ad02d1763b0e2a867684c9ea59992ba6db9377b782c done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [ingest-occurrences internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [ingest-occurrences internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [ingest-occurrences internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [ingest-occurrences 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [ingest-occurrences internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [ingest-occurrences 2/4] COPY . /usr/src/sentry

6 CACHED

7 [ingest-occurrences 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [ingest-occurrences 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [ingest-occurrences] exporting to image

9 exporting layers done

9 writing image sha256:e3d9bb6063cb9e3e264926ba6e00c1bb196b184e08329291cea9db5c210950db done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [ingest-profiles internal] load build definition from Dockerfile

1 DONE 0.0s

2 [ingest-profiles internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

1 [ingest-profiles internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

3 [ingest-profiles internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [ingest-profiles 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [ingest-profiles internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [ingest-profiles 2/4] COPY . /usr/src/sentry

6 CACHED

7 [ingest-profiles 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [ingest-profiles 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [ingest-profiles] exporting to image

9 exporting layers done

9 writing image sha256:304995f700560cd2a53cc4d7c0d7446ea10aeeaef3a8595102abb055ddc92b82 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [ingest-replay-recordings internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [ingest-replay-recordings internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [ingest-replay-recordings internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [ingest-replay-recordings 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [ingest-replay-recordings internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [ingest-replay-recordings 2/4] COPY . /usr/src/sentry

6 CACHED

7 [ingest-replay-recordings 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [ingest-replay-recordings 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [ingest-replay-recordings] exporting to image

9 exporting layers done

9 writing image sha256:e618985970c7d679c1851a3ddb42a6d0f5e9a181d12d3ae23b70e133b4f3eb69 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [metrics-consumer internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [metrics-consumer internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [metrics-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [metrics-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [metrics-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [metrics-consumer 2/4] COPY . /usr/src/sentry

6 CACHED

7 [metrics-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [metrics-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [metrics-consumer] exporting to image

9 exporting layers done

9 writing image sha256:ebbac301624e6aca61a6d459d032dde3bdc1acb3a28acc8d583c725fcf4c37c2 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [web internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [web internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [web internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [web 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [web internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [web 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [web 2/4] COPY . /usr/src/sentry

7 CACHED

8 [web 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [web] exporting to image

9 exporting layers done

9 writing image sha256:12a7123827a0aea9b665fa4e1a61ed04aff1712e1ac8203fd755021a3b7e9727 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [post-process-forwarder-errors internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [post-process-forwarder-errors internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [post-process-forwarder-errors internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [post-process-forwarder-errors 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [post-process-forwarder-errors internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [post-process-forwarder-errors 2/4] COPY . /usr/src/sentry

6 CACHED

7 [post-process-forwarder-errors 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [post-process-forwarder-errors 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [post-process-forwarder-errors] exporting to image

9 exporting layers done

9 writing image sha256:cce784a4cfc48b8c58b1a801c101d511774d14e96c76b55a033a7a3c7578b18a done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [post-process-forwarder-issue-platform internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [post-process-forwarder-issue-platform internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [post-process-forwarder-issue-platform internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [post-process-forwarder-issue-platform 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [post-process-forwarder-issue-platform internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [post-process-forwarder-issue-platform 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [post-process-forwarder-issue-platform 2/4] COPY . /usr/src/sentry

7 CACHED

8 [post-process-forwarder-issue-platform 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [post-process-forwarder-issue-platform] exporting to image

9 exporting layers done

9 writing image sha256:5fcfe0649788db71caea463423c913e90c07e5c137516edca4104923e4249f4c done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [post-process-forwarder-transactions internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [post-process-forwarder-transactions internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [post-process-forwarder-transactions internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [post-process-forwarder-transactions 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [post-process-forwarder-transactions internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [post-process-forwarder-transactions 2/4] COPY . /usr/src/sentry

6 CACHED

7 [post-process-forwarder-transactions 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [post-process-forwarder-transactions 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [post-process-forwarder-transactions] exporting to image

9 exporting layers done

9 writing image sha256:3df44faac9c600e26f80a701f7f931320e46541ecc90b57007da2a443077d447 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [sentry-cleanup internal] load build definition from Dockerfile

1 DONE 0.0s

2 [sentry-cleanup internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

1 [sentry-cleanup internal] load build definition from Dockerfile

1 transferring dockerfile: 469B done

1 DONE 0.0s

3 [sentry-cleanup internal] load metadata for docker.io/library/sentry-self-hosted-local:latest

3 DONE 0.0s

4 [sentry-cleanup internal] load build context

4 transferring context: 35B done

4 DONE 0.0s

5 [sentry-cleanup 1/5] FROM docker.io/library/sentry-self-hosted-local

5 DONE 0.0s

6 [sentry-cleanup 2/5] RUN if [ -z "${http_proxy}" ]; then echo "Acquire::http::proxy "${http_proxy}";" >> /etc/apt/apt.conf; fi

6 DONE 0.2s

7 [sentry-cleanup 3/5] RUN if [ -z "${https_proxy}" ]; then echo "Acquire::https::proxy "${https_proxy}";" >> /etc/apt/apt.conf; fi

7 DONE 0.4s

8 [sentry-cleanup 4/5] RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*

8 0.543 Get:1 http://deb.debian.org/debian bullseye InRelease [116 kB]

8 0.558 Get:2 http://deb.debian.org/debian-security bullseye-security InRelease [48.4 kB]

8 0.562 Get:3 http://deb.debian.org/debian bullseye-updates InRelease [44.1 kB]

8 0.684 Get:4 http://deb.debian.org/debian bullseye/main amd64 Packages [8062 kB]

8 0.809 Get:5 http://deb.debian.org/debian-security bullseye-security/main amd64 Packages [264 kB]

8 0.888 Get:6 http://deb.debian.org/debian bullseye-updates/main amd64 Packages [18.8 kB]

8 1.583 Fetched 8554 kB in 1s (7950 kB/s)

8 1.583 Reading package lists...

8 1.978 Reading package lists...

8 2.358 Building dependency tree...

8 2.445 Reading state information...

8 2.548 The following additional packages will be installed:

8 2.548 sensible-utils

8 2.549 Suggested packages:

8 2.549 anacron logrotate checksecurity

8 2.549 Recommended packages:

8 2.549 default-mta | mail-transport-agent

8 2.582 The following NEW packages will be installed:

8 2.582 cron sensible-utils

8 2.632 0 upgraded, 2 newly installed, 0 to remove and 1 not upgraded.

8 2.632 Need to get 114 kB of archives.

8 2.632 After this operation, 314 kB of additional disk space will be used.

8 2.632 Get:1 http://deb.debian.org/debian bullseye/main amd64 sensible-utils all 0.0.14 [14.8 kB]

8 2.639 Get:2 http://deb.debian.org/debian bullseye/main amd64 cron amd64 3.0pl1-137 [99.6 kB]

8 2.828 debconf: delaying package configuration, since apt-utils is not installed

8 2.851 Fetched 114 kB in 0s (1936 kB/s)

8 2.877 Selecting previously unselected package sensible-utils.

(Reading database ... 7034 files and directories currently installed.)

8 2.913 Preparing to unpack .../sensible-utils_0.0.14_all.deb ...

8 2.915 Unpacking sensible-utils (0.0.14) ...

8 2.940 Selecting previously unselected package cron.

8 2.941 Preparing to unpack .../cron_3.0pl1-137_amd64.deb ...

8 2.943 Unpacking cron (3.0pl1-137) ...

8 2.974 Setting up sensible-utils (0.0.14) ...

8 2.979 Setting up cron (3.0pl1-137) ...

8 3.022 Adding group `crontab' (GID 101) ...

8 3.036 Done.

8 3.064 invoke-rc.d: could not determine current runlevel

8 3.067 invoke-rc.d: policy-rc.d denied execution of start.

8 DONE 3.2s

9 [sentry-cleanup 5/5] COPY entrypoint.sh /entrypoint.sh

9 DONE 0.0s

10 [sentry-cleanup] exporting to image

10 exporting layers 0.0s done

10 writing image sha256:225c00ec01600efbcdaab5fb08c9a9a5e7c5614d89bc71e0b8b6e8089a697603 done

10 naming to docker.io/library/sentry-cleanup-self-hosted-local done

10 DONE 0.0s

0 building with "default" instance using docker driver

1 [subscription-consumer-events internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [subscription-consumer-events internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [subscription-consumer-events internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [subscription-consumer-events 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [subscription-consumer-events internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [subscription-consumer-events 2/4] COPY . /usr/src/sentry

6 CACHED

7 [subscription-consumer-events 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [subscription-consumer-events 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [subscription-consumer-events] exporting to image

9 exporting layers done

9 writing image sha256:08a1d779183f089551402d622600728abf519738470ee3a42addfb1ce3ed526c done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [subscription-consumer-generic-metrics internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [subscription-consumer-generic-metrics internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [subscription-consumer-generic-metrics internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [subscription-consumer-generic-metrics 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [subscription-consumer-generic-metrics internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [subscription-consumer-generic-metrics 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

6 CACHED

7 [subscription-consumer-generic-metrics 2/4] COPY . /usr/src/sentry

7 CACHED

8 [subscription-consumer-generic-metrics 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [subscription-consumer-generic-metrics] exporting to image

9 exporting layers done

9 writing image sha256:7e8007b210d33619eda9822914053f2d587070ec3091c6a4fd5eb6de022a497b done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [subscription-consumer-metrics internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [subscription-consumer-metrics internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [subscription-consumer-metrics internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [subscription-consumer-metrics 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [subscription-consumer-metrics internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [subscription-consumer-metrics 2/4] COPY . /usr/src/sentry

6 CACHED

7 [subscription-consumer-metrics 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [subscription-consumer-metrics 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [subscription-consumer-metrics] exporting to image

9 exporting layers done

9 writing image sha256:ff9f50a835e7be1322f581360ba2dd83819f0c54e49aada6322979a741344967 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [subscription-consumer-transactions internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [subscription-consumer-transactions internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [subscription-consumer-transactions internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [subscription-consumer-transactions 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [subscription-consumer-transactions internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [subscription-consumer-transactions 2/4] COPY . /usr/src/sentry

6 CACHED

7 [subscription-consumer-transactions 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [subscription-consumer-transactions 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [subscription-consumer-transactions] exporting to image

9 exporting layers done

9 writing image sha256:fb1a86d7a0ba577afd7a8b00076e11528df2bbb5596688316e617ea20069ffaf done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [symbolicator-cleanup internal] load build definition from Dockerfile

1 transferring dockerfile: 469B done

1 DONE 0.0s

2 [symbolicator-cleanup internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [symbolicator-cleanup internal] load metadata for docker.io/getsentry/symbolicator:23.11.1

3 DONE 0.0s

4 [symbolicator-cleanup internal] load build context

4 transferring context: 35B done

4 DONE 0.0s

5 [symbolicator-cleanup 1/5] FROM docker.io/getsentry/symbolicator:23.11.1

5 DONE 0.0s

6 [symbolicator-cleanup 2/5] RUN if [ -z "${http_proxy}" ]; then echo "Acquire::http::proxy "${http_proxy}";" >> /etc/apt/apt.conf; fi

6 DONE 0.2s

7 [symbolicator-cleanup 3/5] RUN if [ -z "${https_proxy}" ]; then echo "Acquire::https::proxy "${https_proxy}";" >> /etc/apt/apt.conf; fi

7 DONE 0.4s

8 [symbolicator-cleanup 4/5] RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*

8 0.410 Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB]

8 0.427 Get:2 http://deb.debian.org/debian bookworm-updates InRelease [52.1 kB]

8 0.433 Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]

8 0.509 Get:4 http://deb.debian.org/debian bookworm/main amd64 Packages [8787 kB]

8 0.620 Get:5 http://deb.debian.org/debian bookworm-updates/main amd64 Packages [12.7 kB]

8 0.628 Get:6 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [134 kB]

8 1.442 Fetched 9185 kB in 1s (8479 kB/s)

8 1.442 Reading package lists...

8 1.879 Reading package lists...

8 2.291 Building dependency tree...

8 2.388 Reading state information...

8 2.514 The following additional packages will be installed:

8 2.515 cron-daemon-common sensible-utils

8 2.517 Suggested packages:

8 2.517 anacron logrotate checksecurity

8 2.517 Recommended packages:

8 2.517 default-mta | mail-transport-agent

8 2.550 The following NEW packages will be installed:

8 2.551 cron cron-daemon-common sensible-utils

8 2.585 0 upgraded, 3 newly installed, 0 to remove and 9 not upgraded.

8 2.585 Need to get 105 kB of archives.

8 2.585 After this operation, 325 kB of additional disk space will be used.

8 2.585 Get:1 http://deb.debian.org/debian bookworm/main amd64 cron-daemon-common all 3.0pl1-162 [12.7 kB]

8 2.592 Get:2 http://deb.debian.org/debian bookworm/main amd64 sensible-utils all 0.0.17+nmu1 [19.0 kB]

8 2.593 Get:3 http://deb.debian.org/debian bookworm/main amd64 cron amd64 3.0pl1-162 [73.1 kB]

8 2.797 debconf: delaying package configuration, since apt-utils is not installed

8 2.820 Fetched 105 kB in 0s (2390 kB/s)

8 2.845 Selecting previously unselected package cron-daemon-common.

(Reading database ... 6736 files and directories currently installed.)

8 2.874 Preparing to unpack .../cron-daemon-common_3.0pl1-162_all.deb ...

8 2.880 Unpacking cron-daemon-common (3.0pl1-162) ...

8 2.900 Selecting previously unselected package sensible-utils.

8 2.901 Preparing to unpack .../sensible-utils_0.0.17+nmu1_all.deb ...

8 2.903 Unpacking sensible-utils (0.0.17+nmu1) ...

8 2.925 Setting up cron-daemon-common (3.0pl1-162) ...

8 2.967 Adding group `crontab' (GID 101) ...

8 2.981 Done.

8 3.007 Selecting previously unselected package cron.

(Reading database ... 6781 files and directories currently installed.)

8 3.012 Preparing to unpack .../cron_3.0pl1-162_amd64.deb ...

8 3.015 Unpacking cron (3.0pl1-162) ...

8 3.041 Setting up sensible-utils (0.0.17+nmu1) ...

8 3.045 Setting up cron (3.0pl1-162) ...

8 3.072 invoke-rc.d: could not determine current runlevel

8 3.075 invoke-rc.d: policy-rc.d denied execution of start.

8 DONE 3.3s

9 [symbolicator-cleanup 5/5] COPY entrypoint.sh /entrypoint.sh

9 DONE 0.0s

10 [symbolicator-cleanup] exporting to image

10 exporting layers 0.0s done

10 writing image sha256:2fb19a177497067e1609506ca261a6ce3f305d55fd7c78cc95fe9a6fb993bf11 done

10 naming to docker.io/library/symbolicator-cleanup-self-hosted-local done

10 DONE 0.0s

0 building with "default" instance using docker driver

1 [transactions-consumer internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [transactions-consumer internal] load build definition from Dockerfile

2 transferring dockerfile: 463B done

2 DONE 0.0s

3 [transactions-consumer internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [transactions-consumer 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [transactions-consumer internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [transactions-consumer 2/4] COPY . /usr/src/sentry

6 CACHED

7 [transactions-consumer 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [transactions-consumer 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [transactions-consumer] exporting to image

9 exporting layers done

9 writing image sha256:995486beb43753e674df40225cd7e069073f7ba27e1639a9cb05f3fb757bc716 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

0 building with "default" instance using docker driver

1 [vroom-cleanup internal] load .dockerignore

1 transferring context: 2B done

1 DONE 0.0s

2 [vroom-cleanup internal] load build definition from Dockerfile

2 transferring dockerfile: 469B done

2 DONE 0.0s

3 [vroom-cleanup internal] load metadata for docker.io/getsentry/vroom:23.11.1

3 DONE 0.0s

4 [vroom-cleanup internal] load build context

4 transferring context: 35B done

4 DONE 0.0s

5 [vroom-cleanup 1/5] FROM docker.io/getsentry/vroom:23.11.1

5 DONE 0.0s

6 [vroom-cleanup 2/5] RUN if [ -z "${http_proxy}" ]; then echo "Acquire::http::proxy "${http_proxy}";" >> /etc/apt/apt.conf; fi

6 DONE 0.1s

7 [vroom-cleanup 3/5] RUN if [ -z "${https_proxy}" ]; then echo "Acquire::https::proxy "${https_proxy}";" >> /etc/apt/apt.conf; fi

7 DONE 0.3s

8 [vroom-cleanup 4/5] RUN apt-get update && apt-get install -y --no-install-recommends cron && rm -r /var/lib/apt/lists/*

8 0.357 Get:1 http://deb.debian.org/debian bookworm InRelease [151 kB]

8 0.375 Get:2 http://deb.debian.org/debian bookworm-updates InRelease [52.1 kB]

8 0.383 Get:3 http://deb.debian.org/debian-security bookworm-security InRelease [48.0 kB]

8 0.437 Get:4 http://deb.debian.org/debian bookworm/main amd64 Packages [8787 kB]

8 0.539 Get:5 http://deb.debian.org/debian bookworm-updates/main amd64 Packages [12.7 kB]

8 0.546 Get:6 http://deb.debian.org/debian-security bookworm-security/main amd64 Packages [134 kB]

8 1.374 Fetched 9185 kB in 1s (8823 kB/s)

8 1.374 Reading package lists...

8 1.800 Reading package lists...

8 2.222 Building dependency tree...

8 2.321 Reading state information...

8 2.446 The following additional packages will be installed:

8 2.447 cron-daemon-common sensible-utils

8 2.448 Suggested packages:

8 2.448 anacron logrotate checksecurity

8 2.448 Recommended packages:

8 2.448 default-mta | mail-transport-agent

8 2.481 The following NEW packages will be installed:

8 2.481 cron cron-daemon-common sensible-utils

8 2.512 0 upgraded, 3 newly installed, 0 to remove and 6 not upgraded.

8 2.512 Need to get 105 kB of archives.

8 2.512 After this operation, 325 kB of additional disk space will be used.

8 2.512 Get:1 http://deb.debian.org/debian bookworm/main amd64 cron-daemon-common all 3.0pl1-162 [12.7 kB]

8 2.519 Get:2 http://deb.debian.org/debian bookworm/main amd64 sensible-utils all 0.0.17+nmu1 [19.0 kB]

8 2.520 Get:3 http://deb.debian.org/debian bookworm/main amd64 cron amd64 3.0pl1-162 [73.1 kB]

8 2.629 debconf: delaying package configuration, since apt-utils is not installed

8 2.650 Fetched 105 kB in 0s (2779 kB/s)

8 2.663 Selecting previously unselected package cron-daemon-common.

(Reading database ... 6586 files and directories currently installed.)

8 2.669 Preparing to unpack .../cron-daemon-common_3.0pl1-162_all.deb ...

8 2.670 Unpacking cron-daemon-common (3.0pl1-162) ...

8 2.688 Selecting previously unselected package sensible-utils.

8 2.688 Preparing to unpack .../sensible-utils_0.0.17+nmu1_all.deb ...

8 2.690 Unpacking sensible-utils (0.0.17+nmu1) ...

8 2.710 Setting up cron-daemon-common (3.0pl1-162) ...

8 2.749 Adding group `crontab' (GID 101) ...

8 2.761 Done.

8 2.790 Selecting previously unselected package cron.

(Reading database ... 6631 files and directories currently installed.)

8 2.796 Preparing to unpack .../cron_3.0pl1-162_amd64.deb ...

8 2.798 Unpacking cron (3.0pl1-162) ...

8 2.823 Setting up sensible-utils (0.0.17+nmu1) ...

8 2.833 Setting up cron (3.0pl1-162) ...

8 2.854 invoke-rc.d: could not determine current runlevel

8 2.857 invoke-rc.d: policy-rc.d denied execution of start.

8 DONE 3.0s

9 [vroom-cleanup 5/5] COPY entrypoint.sh /entrypoint.sh

9 DONE 0.0s

10 [vroom-cleanup] exporting to image

10 exporting layers 0.0s done

10 writing image sha256:b9b4dc53ddf85074f42e8fa3ad606a44fbddfc19cf6abfe21cc5d836e0da3fa1 done

10 naming to docker.io/library/vroom-cleanup-self-hosted-local done

10 DONE 0.0s

0 building with "default" instance using docker driver

1 [worker internal] load build definition from Dockerfile

1 transferring dockerfile: 463B done

1 DONE 0.0s

2 [worker internal] load .dockerignore

2 transferring context: 2B done

2 DONE 0.0s

3 [worker internal] load metadata for docker.io/getsentry/sentry:23.11.1

3 DONE 0.0s

4 [worker 1/4] FROM docker.io/getsentry/sentry:23.11.1

4 DONE 0.0s

5 [worker internal] load build context

5 transferring context: 297B done

5 DONE 0.0s

6 [worker 2/4] COPY . /usr/src/sentry

6 CACHED

7 [worker 3/4] RUN if [ -s /usr/src/sentry/enhance-image.sh ]; then /usr/src/sentry/enhance-image.sh; fi

7 CACHED

8 [worker 4/4] RUN if [ -s /usr/src/sentry/requirements.txt ]; then echo "sentry/requirements.txt is deprecated, use sentry/enhance-image.sh - see https://github.com/getsentry/self-hosted#enhance-sentry-image"; pip install -r /usr/src/sentry/requirements.txt; fi

8 CACHED

9 [worker] exporting to image

9 exporting layers done

9 writing image sha256:419e537a8031dc30303be835c8e317a07701a6a898e727c48c01d04d79389295 done

9 naming to docker.io/library/sentry-self-hosted-local done

9 DONE 0.0s

Docker images built.

▶ Downloading and installing wal2json ...

▶ Bootstrapping and migrating Snuba ... Network sentry-self-hosted_default Creating Network sentry-self-hosted_default Created Container sentry-self-hosted-redis-1 Creating Container sentry-self-hosted-zookeeper-1 Creating Container sentry-self-hosted-clickhouse-1 Creating Container sentry-self-hosted-zookeeper-1 Created Container sentry-self-hosted-redis-1 Created Container sentry-self-hosted-kafka-1 Creating Container sentry-self-hosted-clickhouse-1 Created Container sentry-self-hosted-kafka-1 Created Container sentry-self-hosted-redis-1 Starting Container sentry-self-hosted-clickhouse-1 Starting Container sentry-self-hosted-zookeeper-1 Starting Container sentry-self-hosted-zookeeper-1 Started Container sentry-self-hosted-zookeeper-1 Waiting Container sentry-self-hosted-clickhouse-1 Started Container sentry-self-hosted-redis-1 Started Container sentry-self-hosted-zookeeper-1 Healthy Container sentry-self-hosted-kafka-1 Starting Container sentry-self-hosted-kafka-1 Started 2024-01-08 19:48:08,218 Initializing Snuba... 2024-01-08 19:48:10,409 Snuba initialization took 2.1911338241770864s 2024-01-08 19:48:10,719 Initializing Snuba... 2024-01-08 19:48:12,946 Snuba initialization took 2.227684299927205s 2024-01-08 19:48:12,946 Attempting to connect to Kafka (attempt 0)... 2024-01-08 19:48:12,957 Connected to Kafka on attempt 0 2024-01-08 19:48:12,959 Creating Kafka topics... Container sentry-self-hosted-redis-1 Running Container sentry-self-hosted-clickhouse-1 Running Container sentry-self-hosted-zookeeper-1 Running Container sentry-self-hosted-kafka-1 Running Container sentry-self-hosted-zookeeper-1 Waiting Container sentry-self-hosted-zookeeper-1 Healthy 2024-01-08 19:48:14,740 Initializing Snuba... 2024-01-08 19:48:17,057 Snuba initialization took 2.3177552190609276s 2024-01-08 19:48:17,368 Initializing Snuba... 2024-01-08 19:48:19,709 Snuba initialization took 2.342340380884707s {"module": "snuba.migrations.runner", "event": "Running migration: 0026_gauges_add_raw_tags_hash_column", "severity": "info", "timestamp": "2024-01-08T19:48:19.764197Z"} {"module": "snuba.migrations.runner", "event": "Finished: 0026_gauges_add_raw_tags_hash_column", "severity": "info", "timestamp": "2024-01-08T19:48:19.773515Z"} {"module": "snuba.migrations.runner", "event": "Running migration: 0027_sets_add_raw_tags_column", "severity": "info", "timestamp": "2024-01-08T19:48:19.780024Z"} {"module": "snuba.migrations.runner", "event": "Finished: 0027_sets_add_raw_tags_column", "severity": "info", "timestamp": "2024-01-08T19:48:19.785149Z"} Finished running migrations

▶ Creating additional Kafka topics ...

▶ Ensuring proper PostgreSQL version ...

▶ Setting up / migrating database ... Container sentry-self-hosted-postgres-1 Creating Container sentry-self-hosted-symbolicator-1 Creating Container sentry-self-hosted-smtp-1 Creating Container sentry-self-hosted-memcached-1 Creating Container sentry-self-hosted-clickhouse-1 Running Container sentry-self-hosted-zookeeper-1 Running Container sentry-self-hosted-redis-1 Running Container sentry-self-hosted-kafka-1 Running Container sentry-self-hosted-snuba-outcomes-consumer-1 Creating Container sentry-self-hosted-vroom-1 Creating Container sentry-self-hosted-snuba-transactions-consumer-1 Creating Container sentry-self-hosted-snuba-consumer-1 Creating Container sentry-self-hosted-snuba-api-1 Creating Container sentry-self-hosted-snuba-replacer-1 Creating Container sentry-self-hosted-snuba-subscription-consumer-events-1 Creating Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Creating Container sentry-self-hosted-snuba-consumer-1 Created Container sentry-self-hosted-memcached-1 Created Container sentry-self-hosted-snuba-outcomes-consumer-1 Created Container sentry-self-hosted-smtp-1 Created Container sentry-self-hosted-snuba-transactions-consumer-1 Created Container sentry-self-hosted-symbolicator-1 Created Container sentry-self-hosted-postgres-1 Created Container sentry-self-hosted-snuba-replacer-1 Created Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Created Container sentry-self-hosted-vroom-1 Created Container sentry-self-hosted-snuba-subscription-consumer-events-1 Created Container sentry-self-hosted-snuba-api-1 Created Container sentry-self-hosted-smtp-1 Starting Container sentry-self-hosted-memcached-1 Starting Container sentry-self-hosted-zookeeper-1 Waiting Container sentry-self-hosted-postgres-1 Starting Container sentry-self-hosted-symbolicator-1 Starting Container sentry-self-hosted-smtp-1 Started Container sentry-self-hosted-postgres-1 Started Container sentry-self-hosted-zookeeper-1 Healthy Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-clickhouse-1 Waiting Container sentry-self-hosted-kafka-1 Waiting Container sentry-self-hosted-redis-1 Waiting Container sentry-self-hosted-symbolicator-1 Started Container sentry-self-hosted-memcached-1 Started Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-snuba-transactions-consumer-1 Starting Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-snuba-subscription-consumer-events-1 Starting Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-snuba-outcomes-consumer-1 Starting Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-clickhouse-1 Healthy Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Starting Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-snuba-api-1 Starting Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-vroom-1 Starting Container sentry-self-hosted-redis-1 Healthy Container sentry-self-hosted-snuba-replacer-1 Starting Container sentry-self-hosted-kafka-1 Healthy Container sentry-self-hosted-snuba-consumer-1 Starting Container sentry-self-hosted-snuba-transactions-consumer-1 Started Container sentry-self-hosted-snuba-outcomes-consumer-1 Started Container sentry-self-hosted-snuba-subscription-consumer-transactions-1 Started Container sentry-self-hosted-vroom-1 Started Container sentry-self-hosted-snuba-consumer-1 Started Container sentry-self-hosted-snuba-replacer-1 Started Container sentry-self-hosted-snuba-api-1 Started Container sentry-self-hosted-snuba-subscription-consumer-events-1 Started Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Running migrations for default Operations to perform: Apply all migrations: auth, contenttypes, feedback, hybridcloud, nodestore, replays, sentry, sessions, sites, social_auth Running migrations: Applying hybridcloud.0009_make_user_id_optional_for_slug_reservation_replica... OK Applying sentry.0601_add_has_sourcemaps_project_flag... OK Applying sentry.0602_import_chunk_unique_together... OK Applying sentry.0603_add_dangerous_but_trivial_index... OK Applying sentry.0604_remove_dangerous_but_trivial_index... OK Applying sentry.0605_addremove_dangerous_but_trivial_index... OK Applying sentry.0606_update_user_to_optional_organization_slug_reservation... OK Creating missing DSNs Correcting Group.num_comments counter 19:49:00 [INFO] sentry.outboxes: Executing outbox replication backfill 19:49:00 [INFO] sentry.outboxes: Processing sentry.ControlOutboxs... 19:49:00 [INFO] sentry.outboxes: Processing sentry.RegionOutboxs... 19:49:00 [INFO] sentry.outboxes: done

▶ Setting up GeoIP integration ... Setting up IP address geolocation ... IP address geolocation database already exists. IP address geolocation is not configured for updates. See https://develop.sentry.dev/self-hosted/geolocation/ for instructions. Error setting up IP address geolocation.

You're all done! Run the following command to get Sentry running:

docker compose up -d

Event ID

No response

aldy505 commented 6 months ago

The event has just occurred ~6 minutes ago from your screenshot. The session replay processing is not instant, you should wait a bit longer. Depending on your event rates and CPU/RAM resource, it can take a few good minutes to a few hour (perhaps 2 hours max).

If nothing is still coming up, can you try to upgrade your Sentry instance to latest? Just jump to 24.2.0 version. Try to also check your feature flags: is there anything that's missing from this default list? https://github.com/getsentry/self-hosted/blob/8d2da229a2264e31790f736f31d2f6c3a31d0c50/sentry/sentry.conf.example.py#L262-L290

hostinqer commented 6 months ago

The event has just occurred ~6 minutes ago from your screenshot. The session replay processing is not instant, you should wait a bit longer. Depending on your event rates and CPU/RAM resource, it can take a few good minutes to a few hour (perhaps 2 hours max).

If nothing is still coming up, can you try to upgrade your Sentry instance to latest? Just jump to 24.2.0 version. Try to also check your feature flags: is there anything that's missing from this default list?

https://github.com/getsentry/self-hosted/blob/8d2da229a2264e31790f736f31d2f6c3a31d0c50/sentry/sentry.conf.example.py#L262-L290

Thank you for reply!

  1. I watched the event from 20 hours ago, but the problem is the same. nothing shows up. (attached screenshot)

new

  1. I'll try to update the out of hours update sentry and see if the problem is fixed or not.

  2. After editing the sentry.conf.py file, is it enough to restart the containers or do I need to run ./install.sh again?

also check:

    feature: True
    for feature in (
        "organizations:discover",
        "organizations:events",
        "organizations:global-views",
        "organizations:incidents",
        "organizations:integrations-issue-basic",
        "organizations:integrations-issue-sync",
        "organizations:invite-members",
        "organizations:metric-alert-builder-aggregate",
        "organizations:sso-basic",
        "organizations:sso-rippling",
        "organizations:sso-saml2",
        "organizations:performance-view",
        "organizations:advanced-search",
        "organizations:session-replay",
        "organizations:issue-platform",
        "organizations:profiling",
        "organizations:dashboards-mep",
        "organizations:mep-rollout-flag",
        "organizations:dashboards-rh-widget",
        "organizations:metrics-extraction",
        "organizations:transaction-metrics-extraction",
        "projects:custom-inbound-filters",
        "projects:data-forwarding",
        "projects:discard-groups",
        "projects:plugins",
        "projects:rate-limits",
        "projects:servicehooks",
aldy505 commented 6 months ago

It's always safer to run sudo ./install.sh rather than just restarting everything after changing that configuration file. I'd suggest you to just upgrade it while you're at it.

hostinqer commented 6 months ago

Thanks, I'll try to update and report back.

hostinqer commented 6 months ago

I upgraded to the latest version 24.2.0. Starting from version 23.12.0 it started to show as in the screenshot (attached screenshot)

notfound

hostinqer commented 6 months ago

I found this 

docker ps|grep replay
59257e592427   sentry-self-hosted-local                 "/etc/sentry/entrypo…"   2 hours ago   Restarting (1) 28 seconds ago                                           sentry-self-hosted-ingest-replay-recordings-1
4e7769d2c0bd   getsentry/snuba:24.2.0                   "./docker_entrypoint…"   2 hours ago   Up 2 hours                      1218-1219/tcp                           sentry-self-hosted-snuba-replays-consumer-1

ERROR

11:14:32 [INFO] arroyo.processing.processor: New partitions assigned: {Partition(topic=Topic(name='ingest-replay-recordings'), index=0): 8438548}
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/arroyo/processing/processor.py", line 319, in run
    self._run_once()
  File "/usr/local/lib/python3.11/site-packages/arroyo/processing/processor.py", line 381, in _run_once
    self.__message = self.__consumer.poll(timeout=1.0)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/arroyo/backends/kafka/consumer.py", line 414, in poll
    raise OffsetOutOfRange(str(error))
arroyo.errors.OffsetOutOfRange: KafkaError{code=_AUTO_OFFSET_RESET,val=-140,str="fetch failed due to requested offset not available on the broker: Broker: Offset out of range (broker 1001)"}
11:14:32 [ERROR] arroyo.processing.processor: Caught exception, shutting down...
11:14:32 [INFO] arroyo.processing.processor: Closing <arroyo.backends.kafka.consumer.KafkaConsumer object at 0x7fb6723b3810>...
11:14:32 [INFO] arroyo.processing.processor: Partitions to revoke: [Partition(topic=Topic(name='ingest-replay-recordings'), index=0)]
11:14:32 [INFO] arroyo.processing.processor: Partition revocation complete.
11:14:32 [INFO] arroyo.processing.processor: Processor terminated
Traceback (most recent call last):
  File "/usr/local/bin/sentry", line 8, in <module>
    sys.exit(main())
             ^^^^^^
  File "/usr/local/lib/python3.11/site-packages/sentry/runner/__init__.py", line 190, in main
    func(**kwargs)
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1688, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/sentry/runner/decorators.py", line 69, in inner
    return ctx.invoke(f, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
    return f(get_current_context(), *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/sentry/runner/decorators.py", line 29, in inner
    return ctx.invoke(f, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/sentry/runner/commands/run.py", line 557, in basic_consumer
    run_processor_with_signals(processor, consumer_name)
  File "/usr/local/lib/python3.11/site-packages/sentry/utils/kafka.py", line 46, in run_processor_with_signals
    processor.run()
  File "/usr/local/lib/python3.11/site-packages/arroyo/processing/processor.py", line 319, in run
    self._run_once()
  File "/usr/local/lib/python3.11/site-packages/arroyo/processing/processor.py", line 381, in _run_once
    self.__message = self.__consumer.poll(timeout=1.0)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/arroyo/backends/kafka/consumer.py", line 414, in poll
    raise OffsetOutOfRange(str(error))
arroyo.errors.OffsetOutOfRange: KafkaError{code=_AUTO_OFFSET_RESET,val=-140,str="fetch failed due to requested offset not available on the broker: Broker: Offset out of range (broker 1001)"}
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.
hubertdeng123 commented 6 months ago

Perhaps you may want to try deleting your kafka offsets. Perhaps this comment is useful? https://github.com/getsentry/self-hosted/issues/1894#issuecomment-1426538497

hostinqer commented 6 months ago

Perhaps you may want to try deleting your kafka offsets. Perhaps this comment is useful? #1894 (comment)

yes, this is solve problem with :

arroyo.errors.OffsetOutOfRange: KafkaError{code=_AUTO_OFFSET_RESET,val=-140,str="fetch failed due to requested offset not available on the broker: Broker: Offset out of range (broker 1001)"}

but the "Replay Not Found" problem is still there. :(

I add the result of command : docker-compose logs| grep -e 'ERROR\|error\|fail\|failed' error.txt

https://develop.sentry.dev/self-hosted/troubleshooting/#kafka Reuslt of this commands in screenshot:

docker compose run --rm kafka kafka-consumer-groups --bootstrap-server kafka:9092 --list
docker compose run --rm kafka kafka-consumer-groups --bootstrap-server kafka:9092 --group snuba-consumers --describe
docker compose run --rm kafka kafka-consumer-groups --bootstrap-server kafka:9092 --group snuba-consumers --topic events --reset-offsets --to-latest --dry-run
docker compose run --rm kafka kafka-consumer-groups --bootstrap-server kafka:9092 --group snuba-consumers --topic events --reset-offsets --to-latest --execute

Screenshot 2024-02-24 152929

Probel with container also solved , no longer restarts, before restarted every 10 seconds :

sentry-self-hosted-ingest-replay-recordings-1 sentry-self-hosted-local "/etc/sentry/entrypoint.sh run consumer ingest-replay-recordings --consumer-group ingest-replay-recordings" ingest-replay-recordings 2 hours ago Up 5 seconds 9000/tcp

It already blows my mind 3 days ...

aldy505 commented 6 months ago

So... right now all of your containers are healthy, yet you're still not seeing any session replay to be playable?

If everything's okay on the Sentry deployment, you've double checked your feature flags, your server storage has some storage spares remaining.... you might want to try to upgrade your React SDK, see if it solves the problem. (at this point I wonder if the SDK is the problem, but this might be a very suspicious edge case).

hostinqer commented 6 months ago

Yes, all container is running and healthy except this one 

 docker ps --filter "status=exited" --filter "health=unhealthy"
CONTAINER ID   IMAGE                                COMMAND                  CREATED        STATUS                    PORTS     NAMES
3422b7251b55   ghcr.io/maxmind/geoipupdate:v6.0.0   "/usr/bin/geoipupdat…"   24 hours ago   Exited (1) 24 hours ago             sentry-self-hosted-geoipupdate-1

Yes, all containers are working and healthy except this one. But I don't think that this container is important now, and I don't think it's the cause of the problem. Because it's always failed for me. Everything else has always worked fine.

For double check :

        feature: True
        for feature in (
            "organizations:discover",
            "organizations:events",
            "organizations:global-views",
            "organizations:incidents",
            "organizations:integrations-issue-basic",
            "organizations:integrations-issue-sync",
            "organizations:invite-members",
            "organizations:metric-alert-builder-aggregate",
            "organizations:sso-basic",
            "organizations:sso-rippling",
            "organizations:sso-saml2",
            "organizations:performance-view",
            "organizations:advanced-search",
            "organizations:session-replay",
            "organizations:issue-platform",
            "organizations:profiling",
            "organizations:dashboards-mep",
            "organizations:mep-rollout-flag",
            "organizations:dashboards-rh-widget",
            "organizations:metrics-extraction",
            "organizations:transaction-metrics-extraction",
            "projects:custom-inbound-filters",
            "projects:data-forwarding",
            "projects:discard-groups",
            "projects:plugins",
            "projects:rate-limits",
            "projects:servicehooks",

But there's an interesting point. All containers have been running for 25 hours now, except for one that restarted 17 minutes ago.

docker ps -a|grep replay
356718b62097   sentry-self-hosted-local                 "/etc/sentry/entrypo…"   25 hours ago   Up 17 minutes             9000/tcp
      sentry-self-hosted-ingest-replay-recordings-1
394cf08d71ec   getsentry/snuba:24.2.0                   "./docker_entrypoint…"   25 hours ago   Up 25 hours               1218-1219/tcp
      sentry-self-hosted-snuba-replays-consumer-1

attache the log file of this container sentry-self-hosted-ingest-replay-recordings-1 ingest-replay-recordings.txt

I'll take your advice.

hostinqer commented 6 months ago

How can i save all data . Then remove all container and up fresh container with old data? Is it real?

csvan commented 6 months ago

@hostinqer why not do a soft-backup, start over again with a fresh image, do a restore, and then see if the problem persists?

hostinqer commented 6 months ago

@hostinqer why not do a soft-backup, start over again with a fresh image, do a restore, and then see if the problem persists?

docker stop $(docker ps -aq) docker rm $(docker ps -aq) docker rmi $(docker images -q). bash install.sh docker compose up -d

does not help Now when I run sudo docker-compose up -d all containers are up as always and sentry-self-hosted-ingest-replay-recordings-1 container is always in Restarting state.

csvan commented 6 months ago

I meant start with a fresh image - throw everything away, spin up a new server instance, install Sentry, then restore your soft data.

hostinqer commented 6 months ago

I meant start with a fresh image - throw everything away, spin up a new server instance, install Sentry, then restore your soft data.

a, okay. I will try it too

hubertdeng123 commented 6 months ago

Looks like you may have a permission issue on your disk. Your ingest-replay-recordings consumer is restarting because it doesn't have permissions to save

hostinqer commented 6 months ago

Looks like you may have a permission issue on your disk. Your ingest-replay-recordings consumer is restarting because it doesn't have permissions to save

yes, have this error.


 File "/usr/local/lib/python3.11/site-packages/django/core/files/storage/filesystem.py", line 87, in _save
    os.makedirs(directory, exist_ok=True)
  File "<frozen os>", line 215, in makedirs
  File "<frozen os>", line 225, in makedirs
PermissionError: [Errno 13] Permission denied: '/data/files/90/9'
05:40:56 [ERROR] arroyo.processing.processor: Caught exception, shutting down...
05:40:56 [INFO] arroyo.processing.processor: Closing <arroyo.backends.kafka.consumer.KafkaConsumer object at 0x7fd0e900fb50>...
05:40:56 [INFO] arroyo.processing.processor: Partitions to revoke: [Partition(topic=Topic(name='ingest-replay-recordings'), index=0)]
05:40:56 [INFO] arroyo.processing.processor: Partition revocation complete.
05:40:56 [INFO] arroyo.processing.processor: Processor terminated
Updating certificates in /etc/ssl/certs...
0 added, 0 removed; done.
Running hooks in /etc/ca-certificates/update.d...
done.

Is it normal that all file owner root istead of sentry?

docker exec 8294c8e439d6 ls -ltr /data/files/90/| tail -n 5
drwxr-xr-x 2 root root 4096 Dec 18 14:07 62cf
drwxr-xr-x 2 root root 4096 Dec 18 14:09 c635
drwxr-xr-x 2 root root 4096 Dec 18 14:16 46c7
drwxr-xr-x 2 root root 4096 Dec 18 14:16 8ca0
drwxr-xr-x 2 root root 4096 Dec 18 14:20 a573
hubertdeng123 commented 6 months ago

I am not entirely sure, but the file owner for our instance is sentry instead of root. Fixing that may solve your issue.

hostinqer commented 6 months ago

Because the files belonged to root, the container was rebooting. I ran the command until the container stopped restarting.

docker exec 9f682e232ace chown -R sentry:sentry /data/files/

 docker exec 9f6 ls -l data/files/|tail -n 5
drwxr-xr-x 17240 sentry sentry 274432 Dec 18 13:53 fc
drwxr-xr-x 17224 sentry sentry 266240 Dec 18 13:53 fd
drwxr-xr-x 18422 sentry sentry 274432 Feb 21 12:17 fe
drwxr-xr-x 17238 sentry sentry 266240 Dec 18 13:52 ff

No more rebooting reboot

9f682e232ace   sentry-self-hosted-local                 "/etc/sentry/entrypo…"   33 minutes ago   Up 21 minutes             9000/tcp
        sentry-self-hosted-ingest-replay-recordings-1

Thanks to everyone who tried to help!