search

PostHog / posthog

🦔 PostHog provides open-source product analytics, session recording, feature flagging and A/B testing that you can self-host.
https://posthog.com
Other
20.8k stars 1.24k forks source link

Posthog server froze suddently and is unaccessible (self-hosted hobby) #11575

Open adrianwix opened 2 years ago

adrianwix commented 2 years ago

Bug description

The posthog server suddenly stopped working and I can't ssh into the instance. image It is hard to tell what happened exactly but I will try to give as much context as possible

We are using an AWS Lightsails instance with 16 GB RAM, 4 vCPUs, 320 GB SSD

CPU usage remained low: image

You can see here the latest Sentry errors: image

The newest error is this one: image

How to reproduce

  1. Wake up. Make a coffee
  2. Open the website where your posthog installation is located
  3. Posthog is suddenly not working

Environment

Additional context

We installed CloudWatch in a previous posthog deployment (I can't tell the exact version because we killed it but it was some version released around 2 weeks before our current one) and noticed how it would run out of memory and get stuck even if we have no traffic since we were not even using it in production.

image

This is for the CPU back then:

image

Thank you for your bug report – we love squashing them!

nkmnz commented 2 years ago

Do you use VS Code to ssh into the lightsail instance? Might be associated with this problem: https://github.com/microsoft/vscode-remote-release/issues/2692

danielthedifficult commented 2 years ago

I'm having a similar issue, where our hobby deployment fails a few minutes after boot.

This only started happening after updating this afternoon from 1.38 to 1.39.1.

VM stats:

Screen Shot 2022-09-06 at 6 02 14 PM
docker-compose logs shows a bunch of this: ```worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bec0e7a7-c39d-419d-a2ac-c8764c5a6839] worker_1 | 2022-09-06T15:55:14.809749Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bec0e7a7-c39d-419d-a2ac-c8764c5a6839 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[af117571-e0bd-45ae-8d09-1be6e6cf8cde] worker_1 | 2022-09-06T15:55:15.822084Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=af117571-e0bd-45ae-8d09-1be6e6cf8cde worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bc2524a3-ed9a-4b48-beac-d00f0b3fd6c3] worker_1 | 2022-09-06T15:55:16.842447Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bc2524a3-ed9a-4b48-beac-d00f0b3fd6c3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1f46d599-7556-4cda-9ddb-2e820b723152] worker_1 | 2022-09-06T15:55:17.843552Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1f46d599-7556-4cda-9ddb-2e820b723152 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[877bfc1c-0633-4845-9e3d-a72a8bd64dbc] worker_1 | 2022-09-06T15:55:18.858889Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=877bfc1c-0633-4845-9e3d-a72a8bd64dbc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cf2af8a6-868a-41dc-9475-6a1615402779] worker_1 | 2022-09-06T15:55:19.874302Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cf2af8a6-868a-41dc-9475-6a1615402779 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[492f6d85-db2c-4e26-ab44-a15af7f0966b] worker_1 | 2022-09-06T15:55:20.887313Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=492f6d85-db2c-4e26-ab44-a15af7f0966b worker_1 | Received task: posthog.celery.redis_heartbeat[e5967dec-e287-4167-b9af-a8319db8e154] worker_1 | 2022-09-06T15:55:21.757218Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e5967dec-e287-4167-b9af-a8319db8e154 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d3be2e15-00b3-498b-97c6-46e650f32071] worker_1 | 2022-09-06T15:55:21.899488Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d3be2e15-00b3-498b-97c6-46e650f32071 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5aeaad46-ea34-40dd-98e5-c2538ff087e3] worker_1 | 2022-09-06T15:55:22.926345Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5aeaad46-ea34-40dd-98e5-c2538ff087e3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[58338bc5-9aa3-474b-8b22-257c2fc3d79e] worker_1 | 2022-09-06T15:55:23.928742Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=58338bc5-9aa3-474b-8b22-257c2fc3d79e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2e86afe2-1686-4fb2-9931-879cc39ebf09] worker_1 | 2022-09-06T15:55:24.952055Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2e86afe2-1686-4fb2-9931-879cc39ebf09 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d8157749-61c8-4862-8756-f21ba4d44255] worker_1 | 2022-09-06T15:55:25.960238Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d8157749-61c8-4862-8756-f21ba4d44255 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5b2c13ee-eb5c-4b9b-b1f3-c46104481621] worker_1 | 2022-09-06T15:55:26.984217Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5b2c13ee-eb5c-4b9b-b1f3-c46104481621 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[98c86283-ce6e-448b-8652-a7c91fdca89d] worker_1 | 2022-09-06T15:55:28.008628Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=98c86283-ce6e-448b-8652-a7c91fdca89d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[91e48f1c-1c6c-4201-ae7a-9494595f01ec] worker_1 | 2022-09-06T15:55:29.017124Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=91e48f1c-1c6c-4201-ae7a-9494595f01ec worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1d442bfa-82a4-4765-9007-ec360bc203e5] worker_1 | 2022-09-06T15:55:30.018611Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1d442bfa-82a4-4765-9007-ec360bc203e5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e6754749-b72e-425d-ac3e-22e709ccf500] worker_1 | 2022-09-06T15:55:31.036464Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e6754749-b72e-425d-ac3e-22e709ccf500 worker_1 | Received task: posthog.celery.redis_heartbeat[95b90f04-9634-45b9-8511-15aa04b4d6dc] worker_1 | 2022-09-06T15:55:31.768333Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=95b90f04-9634-45b9-8511-15aa04b4d6dc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0b8962d7-9169-439e-b9d7-2c419f2e4e30] worker_1 | 2022-09-06T15:55:32.035454Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0b8962d7-9169-439e-b9d7-2c419f2e4e30 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2ceda84c-5e53-4623-a5e6-2c713923b0c7] worker_1 | 2022-09-06T15:55:33.043326Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2ceda84c-5e53-4623-a5e6-2c713923b0c7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[81c3c489-796c-4237-9c07-3feba5e969bc] worker_1 | 2022-09-06T15:55:34.053106Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=81c3c489-796c-4237-9c07-3feba5e969bc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[054fb836-4822-446b-aa57-1fda204bb6b1] worker_1 | 2022-09-06T15:55:35.080406Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=054fb836-4822-446b-aa57-1fda204bb6b1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9ed2be2d-24d0-4cf0-8f83-6dceafbdcd73] worker_1 | 2022-09-06T15:55:36.090470Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9ed2be2d-24d0-4cf0-8f83-6dceafbdcd73 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[eb8f61c4-f1f6-422c-9311-2e94672c9072] worker_1 | 2022-09-06T15:55:37.095108Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=eb8f61c4-f1f6-422c-9311-2e94672c9072 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6b7110d4-cc9d-438c-8f71-bff96acc0e88] worker_1 | 2022-09-06T15:55:38.105371Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6b7110d4-cc9d-438c-8f71-bff96acc0e88 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e314e52c-542d-4e06-a6b4-d403b651e0d6] worker_1 | 2022-09-06T15:55:39.122813Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e314e52c-542d-4e06-a6b4-d403b651e0d6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[999ad715-c34e-443f-ade8-dd7fd17af485] worker_1 | 2022-09-06T15:55:40.142458Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=999ad715-c34e-443f-ade8-dd7fd17af485 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[34e7fa7d-4b52-4286-80a4-3263d3ae9a03] worker_1 | 2022-09-06T15:55:41.152565Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=34e7fa7d-4b52-4286-80a4-3263d3ae9a03 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[33cdf39f-d639-4b65-8f06-5c2d3c6ff2ff] worker_1 | 2022-09-06T15:55:41.713985Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=33cdf39f-d639-4b65-8f06-5c2d3c6ff2ff worker_1 | Received task: posthog.celery.redis_heartbeat[681c9937-0f4b-4e86-96f4-cccd7f903e4c] worker_1 | 2022-09-06T15:55:41.776513Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=681c9937-0f4b-4e86-96f4-cccd7f903e4c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[80be06a8-f75f-49ce-aa87-f5b0cbc02221] worker_1 | 2022-09-06T15:55:42.161659Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=80be06a8-f75f-49ce-aa87-f5b0cbc02221 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f65d4f87-426e-4e95-91d0-9a96d29f1470] worker_1 | 2022-09-06T15:55:43.176319Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f65d4f87-426e-4e95-91d0-9a96d29f1470 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ce5b4945-fb34-4fa1-874b-c2fd7b0077df] worker_1 | 2022-09-06T15:55:44.186579Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ce5b4945-fb34-4fa1-874b-c2fd7b0077df worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6560759c-843c-46ce-8945-5f2c0724e083] worker_1 | 2022-09-06T15:55:45.204337Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6560759c-843c-46ce-8945-5f2c0724e083 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4327801d-8aa5-4723-9fb7-5cb10ae9e1ba] worker_1 | 2022-09-06T15:55:46.214021Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4327801d-8aa5-4723-9fb7-5cb10ae9e1ba worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5def1961-018e-4a4a-98ac-d6e17bac31ab] worker_1 | 2022-09-06T15:55:47.229941Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5def1961-018e-4a4a-98ac-d6e17bac31ab worker_1 | Received task: posthog.celery.redis_celery_queue_depth[230cfc43-99de-4c10-b888-5ce27aef866b] worker_1 | 2022-09-06T15:55:48.238307Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=230cfc43-99de-4c10-b888-5ce27aef866b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ed88b563-8659-4d93-a2ef-1bdd5fd3648a] worker_1 | 2022-09-06T15:55:49.257164Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ed88b563-8659-4d93-a2ef-1bdd5fd3648a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cc1c5be7-65ec-4b43-85e5-45df530446ea] worker_1 | 2022-09-06T15:55:50.265383Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cc1c5be7-65ec-4b43-85e5-45df530446ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c047ae0c-2784-4abf-80a4-464d603bf0e3] worker_1 | 2022-09-06T15:55:51.283007Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c047ae0c-2784-4abf-80a4-464d603bf0e3 worker_1 | Received task: posthog.celery.redis_heartbeat[2dbbe45a-9d9b-4c9b-9252-4f7859cbc9a6] worker_1 | 2022-09-06T15:55:51.789401Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2dbbe45a-9d9b-4c9b-9252-4f7859cbc9a6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c1994d08-30b2-460f-a294-53a5a8629fae] worker_1 | 2022-09-06T15:55:52.279569Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c1994d08-30b2-460f-a294-53a5a8629fae worker_1 | Received task: posthog.celery.redis_celery_queue_depth[44ef85fe-1e05-491d-a072-809f0c86383b] worker_1 | 2022-09-06T15:55:53.300389Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=44ef85fe-1e05-491d-a072-809f0c86383b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4c1339f7-4bd3-4fb9-ac7c-fc947cc6a7c4] worker_1 | 2022-09-06T15:55:54.310737Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4c1339f7-4bd3-4fb9-ac7c-fc947cc6a7c4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[989aca3e-c01e-42b7-811e-e5ab88ad6a2d] worker_1 | 2022-09-06T15:55:55.330099Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=989aca3e-c01e-42b7-811e-e5ab88ad6a2d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a08913e5-c705-4af6-929a-c41606e3e7be] worker_1 | 2022-09-06T15:55:56.341706Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a08913e5-c705-4af6-929a-c41606e3e7be worker_1 | Received task: posthog.celery.redis_celery_queue_depth[725bae45-253b-4704-b8c3-80f77a2c5609] worker_1 | 2022-09-06T15:55:57.356447Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=725bae45-253b-4704-b8c3-80f77a2c5609 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3381a7c4-6f72-4e91-aef9-eee403a94a9d] worker_1 | 2022-09-06T15:55:58.365486Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3381a7c4-6f72-4e91-aef9-eee403a94a9d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[399b5998-9029-455d-8994-8cc8bf9ce093] worker_1 | 2022-09-06T15:55:59.379613Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=399b5998-9029-455d-8994-8cc8bf9ce093 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[74a2612d-b36e-45bd-968d-84de22c2f17a] worker_1 | 2022-09-06T15:56:00.381983Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=74a2612d-b36e-45bd-968d-84de22c2f17a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f7abf66a-45f8-4acf-ab04-9d80e2dfbca2] worker_1 | 2022-09-06T15:56:01.402030Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f7abf66a-45f8-4acf-ab04-9d80e2dfbca2 worker_1 | Received task: posthog.celery.redis_heartbeat[8bf36e3d-0667-4f5b-a8a2-934ad5d905d4] worker_1 | 2022-09-06T15:56:01.791464Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8bf36e3d-0667-4f5b-a8a2-934ad5d905d4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1bd5ce6f-16af-4040-8775-a5f46c4107ee] worker_1 | 2022-09-06T15:56:02.404583Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1bd5ce6f-16af-4040-8775-a5f46c4107ee worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2909f818-cc15-4700-b832-078309563eae] worker_1 | 2022-09-06T15:56:03.408855Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2909f818-cc15-4700-b832-078309563eae worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5d252cd4-8254-4192-9968-cdad38978be2] worker_1 | 2022-09-06T15:56:04.426531Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5d252cd4-8254-4192-9968-cdad38978be2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5f087d3b-0e6f-4164-a726-2ec175f9416f] worker_1 | 2022-09-06T15:56:05.439443Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5f087d3b-0e6f-4164-a726-2ec175f9416f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a156a67d-7233-40c8-bcb2-f2e30a98b511] worker_1 | 2022-09-06T15:56:06.450819Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a156a67d-7233-40c8-bcb2-f2e30a98b511 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b5515fc6-0d57-4d99-8fe2-4150e23ba247] worker_1 | 2022-09-06T15:56:07.465627Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b5515fc6-0d57-4d99-8fe2-4150e23ba247 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c08a9bb8-2fa8-4ece-b665-94a1e6cfba56] worker_1 | 2022-09-06T15:56:08.474408Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c08a9bb8-2fa8-4ece-b665-94a1e6cfba56 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5d8c8abe-ee0a-4ca5-b163-e00071b745b2] worker_1 | 2022-09-06T15:56:09.481575Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5d8c8abe-ee0a-4ca5-b163-e00071b745b2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9f215920-736e-4481-9e73-5a2fb04747bb] worker_1 | 2022-09-06T15:56:10.498410Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9f215920-736e-4481-9e73-5a2fb04747bb worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4b1b1d50-9d90-4cf5-94dd-8cec7733e67c] worker_1 | 2022-09-06T15:56:11.518348Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4b1b1d50-9d90-4cf5-94dd-8cec7733e67c worker_1 | Received task: posthog.celery.check_cached_items[f123e163-97e1-427d-b11c-199abf5409b1] worker_1 | 2022-09-06T15:56:11.783012Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=9011d799-dd64-46e4-9679-602ca3fb5f3a child_task_name=posthog.celery.update_cache_item_task task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | Received task: posthog.celery.update_cache_item_task[9011d799-dd64-46e4-9679-602ca3fb5f3a] worker_1 | 2022-09-06T15:56:11.789045Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=1649c15a-cb08-4b3e-b564-775585d4745a child_task_name=posthog.celery.update_cache_item_task task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | 2022-09-06T15:56:11.795952Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=6f6f5d07-aa32-4518-9569-972e04acf28e child_task_name=posthog.celery.update_cache_item_task task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | Received task: posthog.celery.update_cache_item_task[1649c15a-cb08-4b3e-b564-775585d4745a] worker_1 | Received task: posthog.celery.update_cache_item_task[6f6f5d07-aa32-4518-9569-972e04acf28e] worker_1 | 2022-09-06T15:56:11.801182Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=0f14b9e3-1803-4959-a45e-ae8c997fe546 child_task_name=posthog.celery.update_cache_item_task task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | 2022-09-06T15:56:11.804278Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=ed3b888e-31ea-4b53-b60a-822bc1a42052 child_task_name=posthog.celery.update_cache_item_task task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | Received task: posthog.celery.update_cache_item_task[0f14b9e3-1803-4959-a45e-ae8c997fe546] worker_1 | Received task: posthog.celery.update_cache_item_task[ed3b888e-31ea-4b53-b60a-822bc1a42052] worker_1 | Received task: posthog.celery.redis_heartbeat[be545e27-9690-4798-9e20-811b8b9f9689] worker_1 | 2022-09-06T15:56:11.818189Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f123e163-97e1-427d-b11c-199abf5409b1 worker_1 | 2022-09-06T15:56:11.981057Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_18016e05130ecf29e71981371e5a92c0 dashboard_id=8 has_results=True insight_id=43 parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=9011d799-dd64-46e4-9679-602ca3fb5f3a worker_1 | 2022-09-06T15:56:11.994294Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=9011d799-dd64-46e4-9679-602ca3fb5f3a worker_1 | 2022-09-06T15:56:12.076333Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=1649c15a-cb08-4b3e-b564-775585d4745a worker_1 | 2022-09-06T15:56:12.382786Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_7725c3c8d96bbe2d77783219706c37c5 dashboard_id=8 has_results=True insight_id=47 parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=6f6f5d07-aa32-4518-9569-972e04acf28e worker_1 | 2022-09-06T15:56:12.385623Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=6f6f5d07-aa32-4518-9569-972e04acf28e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3a83f805-e322-4f17-bc99-8a43e4b6a4df] worker_1 | 2022-09-06T15:56:12.928909Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=0f14b9e3-1803-4959-a45e-ae8c997fe546 worker_1 | 2022-09-06T15:56:12.936228Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=be545e27-9690-4798-9e20-811b8b9f9689 worker_1 | 2022-09-06T15:56:12.941883Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3a83f805-e322-4f17-bc99-8a43e4b6a4df worker_1 | Received task: posthog.celery.redis_celery_queue_depth[95158df5-b661-4d88-bada-b3a033504193] worker_1 | 2022-09-06T15:56:13.528585Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=95158df5-b661-4d88-bada-b3a033504193 worker_1 | 2022-09-06T15:56:13.558089Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_2d3427f975ce03ffb1f2473d2daa89d4 dashboard_id=9 has_results=True insight_id=37 parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=ed3b888e-31ea-4b53-b60a-822bc1a42052 worker_1 | 2022-09-06T15:56:13.564573Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=f123e163-97e1-427d-b11c-199abf5409b1 task_id=ed3b888e-31ea-4b53-b60a-822bc1a42052 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cc2a5af9-e1e6-4651-959f-ff2afc8887c3] worker_1 | 2022-09-06T15:56:14.539491Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cc2a5af9-e1e6-4651-959f-ff2afc8887c3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[936b889e-9999-4230-8c5b-74fd69529299] worker_1 | 2022-09-06T15:56:15.543645Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=936b889e-9999-4230-8c5b-74fd69529299 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5537ca1c-7af3-474d-80be-fa1e0701c6a4] worker_1 | 2022-09-06T15:56:16.567243Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5537ca1c-7af3-474d-80be-fa1e0701c6a4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c8ac420d-b9c7-4dba-964e-4d72ba784f20] worker_1 | 2022-09-06T15:56:17.579074Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c8ac420d-b9c7-4dba-964e-4d72ba784f20 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[25dbfa37-7805-431e-be82-50fc58b1fa19] worker_1 | 2022-09-06T15:56:18.584705Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=25dbfa37-7805-431e-be82-50fc58b1fa19 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[97b91558-43f4-42de-a8f5-7f541af79fbb] worker_1 | 2022-09-06T15:56:19.598053Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=97b91558-43f4-42de-a8f5-7f541af79fbb worker_1 | Received task: posthog.celery.redis_celery_queue_depth[30f31149-f7b3-43d8-a6f9-cc01f06f4921] worker_1 | 2022-09-06T15:56:20.609221Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=30f31149-f7b3-43d8-a6f9-cc01f06f4921 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cc4e2417-f3d7-4c54-8c08-082b17e08b05] worker_1 | 2022-09-06T15:56:21.616948Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cc4e2417-f3d7-4c54-8c08-082b17e08b05 worker_1 | Received task: posthog.celery.redis_heartbeat[837e9c7f-87b0-415f-9cf6-8f043d560ab9] worker_1 | 2022-09-06T15:56:21.809573Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=837e9c7f-87b0-415f-9cf6-8f043d560ab9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[35a9eb94-7fe0-4616-974e-a18074985c68] worker_1 | 2022-09-06T15:56:22.627877Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=35a9eb94-7fe0-4616-974e-a18074985c68 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ba5a576d-e9e2-4336-a0e3-915b565ae194] worker_1 | 2022-09-06T15:56:23.647365Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ba5a576d-e9e2-4336-a0e3-915b565ae194 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[575d9bbb-2f8c-4f55-a5a7-2fa3fed50adb] worker_1 | 2022-09-06T15:56:24.661146Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=575d9bbb-2f8c-4f55-a5a7-2fa3fed50adb worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2afa19d2-9234-41b8-b077-3f0762cdcb04] worker_1 | 2022-09-06T15:56:25.679356Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2afa19d2-9234-41b8-b077-3f0762cdcb04 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bbaa806d-afda-4fd8-bcb4-4ce4839d99d5] worker_1 | 2022-09-06T15:56:26.682356Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bbaa806d-afda-4fd8-bcb4-4ce4839d99d5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7a388607-30f6-41dc-a163-dcb64724bea7] worker_1 | 2022-09-06T15:56:27.705161Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7a388607-30f6-41dc-a163-dcb64724bea7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8d0bec0b-faab-4096-90fc-1d99d78f12a8] worker_1 | 2022-09-06T15:56:28.716630Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8d0bec0b-faab-4096-90fc-1d99d78f12a8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c83ddf77-80c0-4b0a-a431-ebfe0cd8287f] worker_1 | 2022-09-06T15:56:29.721808Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c83ddf77-80c0-4b0a-a431-ebfe0cd8287f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[81b18421-6d2e-440a-8085-2843e255d369] worker_1 | 2022-09-06T15:56:30.726035Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=81b18421-6d2e-440a-8085-2843e255d369 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8d60cb7a-19cb-4300-9ac7-eefb3745c9da] worker_1 | 2022-09-06T15:56:31.741178Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8d60cb7a-19cb-4300-9ac7-eefb3745c9da worker_1 | Received task: posthog.celery.redis_heartbeat[2b284fa4-63eb-4422-ab40-1b31cd17ff63] worker_1 | 2022-09-06T15:56:31.815142Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2b284fa4-63eb-4422-ab40-1b31cd17ff63 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[45cc3ade-ce5c-4d65-b319-a7f85dae30f5] worker_1 | 2022-09-06T15:56:32.749916Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=45cc3ade-ce5c-4d65-b319-a7f85dae30f5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8a5d8499-4f90-413e-af69-8e58d956d7ea] worker_1 | 2022-09-06T15:56:33.762469Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8a5d8499-4f90-413e-af69-8e58d956d7ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5d3deb89-4c05-4ca0-b17d-15c5078b0dd6] worker_1 | 2022-09-06T15:56:34.772087Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5d3deb89-4c05-4ca0-b17d-15c5078b0dd6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c9779408-23ca-400c-bd47-89081c693957] worker_1 | 2022-09-06T15:56:35.790890Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c9779408-23ca-400c-bd47-89081c693957 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[70864447-0c7e-45ff-b8ef-187e7e334f60] worker_1 | 2022-09-06T15:56:36.800136Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=70864447-0c7e-45ff-b8ef-187e7e334f60 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d6918940-25a9-43ee-9a3f-8c252e1490cc] worker_1 | 2022-09-06T15:56:37.821688Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d6918940-25a9-43ee-9a3f-8c252e1490cc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5d16edfc-e36b-411b-bdf9-0ae2fac7ac74] worker_1 | 2022-09-06T15:56:38.831188Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5d16edfc-e36b-411b-bdf9-0ae2fac7ac74 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8dc472c5-9d94-458f-84f7-68c0c3e66bb5] worker_1 | 2022-09-06T15:56:39.843597Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8dc472c5-9d94-458f-84f7-68c0c3e66bb5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4cef7410-fa30-4b98-8c73-c7a1b43a0bda] worker_1 | 2022-09-06T15:56:40.863094Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4cef7410-fa30-4b98-8c73-c7a1b43a0bda worker_1 | Received task: posthog.celery.redis_heartbeat[69df7434-6dd0-4823-9b17-a2e42660e2a1] worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[9875532a-7b3c-49a3-b7a0-07df84cc1942] worker_1 | 2022-09-06T15:56:41.834577Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=69df7434-6dd0-4823-9b17-a2e42660e2a1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aa9e624c-f862-478e-aa85-bc3772ac59c9] worker_1 | 2022-09-06T15:56:41.874272Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aa9e624c-f862-478e-aa85-bc3772ac59c9 worker_1 | 2022-09-06T15:56:41.881550Z [info ] check_clickhouse_schema_drift [posthog.tasks.check_clickhouse_schema_drift] table_count=0 tables=[] task_id=9875532a-7b3c-49a3-b7a0-07df84cc1942 worker_1 | 2022-09-06T15:56:41.883118Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9875532a-7b3c-49a3-b7a0-07df84cc1942 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[38e55c7d-d0ac-44c9-a0a9-b72da1722d1d] worker_1 | 2022-09-06T15:56:42.885415Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=38e55c7d-d0ac-44c9-a0a9-b72da1722d1d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[386d0ee9-b078-4b12-b345-d18ff850da81] worker_1 | 2022-09-06T15:56:43.900448Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=386d0ee9-b078-4b12-b345-d18ff850da81 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4971fdda-1d3e-441c-8089-036a61c33fa5] worker_1 | 2022-09-06T15:56:44.911808Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4971fdda-1d3e-441c-8089-036a61c33fa5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4e7cdba9-d940-408b-8bb7-d5eb5c65febc] worker_1 | 2022-09-06T15:56:45.924148Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4e7cdba9-d940-408b-8bb7-d5eb5c65febc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2dd07132-1318-429c-8b3c-7e9f4e3956ea] worker_1 | 2022-09-06T15:56:46.938206Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2dd07132-1318-429c-8b3c-7e9f4e3956ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[625355ad-6e2a-4250-9492-523bc0bda435] worker_1 | 2022-09-06T15:56:47.947622Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=625355ad-6e2a-4250-9492-523bc0bda435 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ee4a9296-87f1-496d-bb22-ce9b1ecbc153] worker_1 | 2022-09-06T15:56:48.950885Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ee4a9296-87f1-496d-bb22-ce9b1ecbc153 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1933ee74-39b2-4ba8-8840-5a58f5f93eec] worker_1 | 2022-09-06T15:56:49.967946Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1933ee74-39b2-4ba8-8840-5a58f5f93eec worker_1 | Received task: posthog.celery.redis_celery_queue_depth[371c4caf-68d8-4c7b-939a-2357ff8d02e6] worker_1 | 2022-09-06T15:56:50.980592Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=371c4caf-68d8-4c7b-939a-2357ff8d02e6 worker_1 | Received task: posthog.celery.redis_heartbeat[11e8bfc6-4cae-4680-875e-989d8725a573] worker_1 | 2022-09-06T15:56:51.834542Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=11e8bfc6-4cae-4680-875e-989d8725a573 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[590eb077-44fd-4a2f-b54b-8e4e2a5f24ff] worker_1 | 2022-09-06T15:56:51.989219Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=590eb077-44fd-4a2f-b54b-8e4e2a5f24ff worker_1 | Received task: posthog.celery.redis_celery_queue_depth[dbff18dd-5319-4ca1-b32c-6e697b2901ff] worker_1 | 2022-09-06T15:56:53.004695Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=dbff18dd-5319-4ca1-b32c-6e697b2901ff worker_1 | Received task: posthog.celery.redis_celery_queue_depth[797fb0a3-694b-453e-856c-5098fedf3ae1] worker_1 | 2022-09-06T15:56:54.024421Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=797fb0a3-694b-453e-856c-5098fedf3ae1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[849a3f75-57f3-42f3-8860-6af071d8cc4a] worker_1 | 2022-09-06T15:56:55.032084Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=849a3f75-57f3-42f3-8860-6af071d8cc4a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5849961e-248f-4732-9e6e-ef01361e4943] worker_1 | 2022-09-06T15:56:56.046854Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5849961e-248f-4732-9e6e-ef01361e4943 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9d1baecc-4732-43ab-a9ef-e11f8d8be66e] worker_1 | 2022-09-06T15:56:57.060238Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9d1baecc-4732-43ab-a9ef-e11f8d8be66e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3ce08b0f-f21b-4381-b16d-ab6d375d8963] worker_1 | 2022-09-06T15:56:58.075650Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3ce08b0f-f21b-4381-b16d-ab6d375d8963 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3fba7520-033c-4fcc-a22d-f4c51cde6934] worker_1 | 2022-09-06T15:56:59.080187Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3fba7520-033c-4fcc-a22d-f4c51cde6934 redis_1 | 1:M 06 Sep 2022 15:57:00.053 * 100 changes in 300 seconds. Saving... redis_1 | 1:M 06 Sep 2022 15:57:00.054 * Background saving started by pid 17 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c4f4cae2-8768-4e8d-9516-0b9117d2e07a] redis_1 | 17:C 06 Sep 2022 15:57:00.089 * DB saved on disk worker_1 | 2022-09-06T15:57:00.089637Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c4f4cae2-8768-4e8d-9516-0b9117d2e07a redis_1 | 17:C 06 Sep 2022 15:57:00.091 * RDB: 0 MB of memory used by copy-on-write redis_1 | 1:M 06 Sep 2022 15:57:00.155 * Background saving terminated with success worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a886122a-65d8-41ae-b8ec-ab538cb000b9] worker_1 | 2022-09-06T15:57:01.104724Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a886122a-65d8-41ae-b8ec-ab538cb000b9 worker_1 | Received task: posthog.celery.graphile_queue_size[41333ae5-2814-41ce-865c-aa62afafb29c] worker_1 | Received task: posthog.celery.pg_table_cache_hit_rate[ab7f0887-dfd1-435e-a0ac-b61f2ad19d6f] worker_1 | 2022-09-06T15:57:01.659637Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=41333ae5-2814-41ce-865c-aa62afafb29c worker_1 | 2022-09-06T15:57:01.681371Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ab7f0887-dfd1-435e-a0ac-b61f2ad19d6f worker_1 | Received task: posthog.celery.redis_heartbeat[677fdbb2-42a4-4f84-bd66-65bcf70ecb4b] worker_1 | 2022-09-06T15:57:01.845928Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=677fdbb2-42a4-4f84-bd66-65bcf70ecb4b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1da1e8e3-d3ec-415a-8232-71520d25d512] worker_1 | 2022-09-06T15:57:02.111543Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1da1e8e3-d3ec-415a-8232-71520d25d512 worker_1 | Received task: posthog.celery.clickhouse_row_count[137f2974-12c3-4eef-88a7-5ddd4e447d1a] worker_1 | 2022-09-06T15:57:02.726877Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=137f2974-12c3-4eef-88a7-5ddd4e447d1a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[81d6b6f5-49d5-42bb-9535-1fb42a723887] worker_1 | 2022-09-06T15:57:03.110174Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=81d6b6f5-49d5-42bb-9535-1fb42a723887 worker_1 | Received task: posthog.celery.clickhouse_lag[10b5bed6-9d51-4379-b715-794069e0f2c2] worker_1 | 2022-09-06T15:57:03.725079Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=10b5bed6-9d51-4379-b715-794069e0f2c2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5c41bccb-f562-4384-9c37-ab73e80493aa] worker_1 | 2022-09-06T15:57:04.114670Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5c41bccb-f562-4384-9c37-ab73e80493aa worker_1 | Received task: posthog.celery.clickhouse_mutation_count[2025a884-3a6c-4b72-bea3-75cffe2c9832] worker_1 | 2022-09-06T15:57:04.617677Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2025a884-3a6c-4b72-bea3-75cffe2c9832 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0aaa0b99-a0ea-46fd-8848-b0ed2d15487b] worker_1 | 2022-09-06T15:57:05.117961Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0aaa0b99-a0ea-46fd-8848-b0ed2d15487b worker_1 | Received task: posthog.celery.clickhouse_part_count[d1537f61-80dc-4790-98eb-2ae841f81b07] worker_1 | 2022-09-06T15:57:05.656229Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d1537f61-80dc-4790-98eb-2ae841f81b07 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ea1f5e6d-f799-45a3-882b-bbf4500bca34] worker_1 | 2022-09-06T15:57:06.124203Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ea1f5e6d-f799-45a3-882b-bbf4500bca34 worker_1 | Received task: posthog.celery.calculate_cohort[65a1dd62-5e83-42c6-938f-8fbcf49f6dff] worker_1 | 2022-09-06T15:57:06.658125Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=65a1dd62-5e83-42c6-938f-8fbcf49f6dff worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ffaa0384-1a8a-4b9f-905c-738b5922a727] worker_1 | 2022-09-06T15:57:07.125163Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ffaa0384-1a8a-4b9f-905c-738b5922a727 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d8743a33-7f95-48b6-acf5-b52fdf234a32] worker_1 | 2022-09-06T15:57:08.133410Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d8743a33-7f95-48b6-acf5-b52fdf234a32 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c0ff9411-3386-42bf-8d5e-229b58358da1] worker_1 | 2022-09-06T15:57:09.140313Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c0ff9411-3386-42bf-8d5e-229b58358da1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b9148e20-b687-498d-aaea-47d344d1810b] worker_1 | 2022-09-06T15:57:10.170597Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b9148e20-b687-498d-aaea-47d344d1810b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c08e0ff8-e94a-4a95-98fc-8bcf1fe4e01d] worker_1 | 2022-09-06T15:57:11.182132Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c08e0ff8-e94a-4a95-98fc-8bcf1fe4e01d worker_1 | Received task: posthog.celery.redis_heartbeat[a81d700c-73d5-47c8-a9bb-a8dcb5e5e234] worker_1 | 2022-09-06T15:57:11.857062Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a81d700c-73d5-47c8-a9bb-a8dcb5e5e234 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a21df141-029f-403a-ac9e-032ad23021cd] worker_1 | 2022-09-06T15:57:12.192971Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a21df141-029f-403a-ac9e-032ad23021cd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6bf98c57-77cb-4c8e-9049-bf3b1f9483fa] worker_1 | 2022-09-06T15:57:13.209514Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6bf98c57-77cb-4c8e-9049-bf3b1f9483fa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5e77e344-d422-497f-b4ea-40fab8a1435f] worker_1 | 2022-09-06T15:57:14.225003Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5e77e344-d422-497f-b4ea-40fab8a1435f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6105a248-1291-4c45-8486-9a5d3d983335] worker_1 | 2022-09-06T15:57:15.237675Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6105a248-1291-4c45-8486-9a5d3d983335 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bb358696-d633-4c00-aeae-e10e19391cdc] worker_1 | 2022-09-06T15:57:16.252253Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bb358696-d633-4c00-aeae-e10e19391cdc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5eca4c88-7f5a-43ae-9413-68543de5a05f] worker_1 | 2022-09-06T15:57:17.266123Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5eca4c88-7f5a-43ae-9413-68543de5a05f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[990ea8e0-ee24-45fa-b62d-fc4e1b024706] worker_1 | 2022-09-06T15:57:18.282052Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=990ea8e0-ee24-45fa-b62d-fc4e1b024706 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1cf82f59-de9e-4d6c-83f9-6b4ffa1d5d9d] worker_1 | 2022-09-06T15:57:19.293844Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1cf82f59-de9e-4d6c-83f9-6b4ffa1d5d9d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[039d8357-1650-4f21-bec3-be2d942d426a] worker_1 | 2022-09-06T15:57:20.310249Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=039d8357-1650-4f21-bec3-be2d942d426a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9b2e3e98-5b2a-4375-9409-315caa51ed3b] worker_1 | 2022-09-06T15:57:21.326215Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9b2e3e98-5b2a-4375-9409-315caa51ed3b worker_1 | Received task: posthog.celery.redis_heartbeat[ddcac0e2-35ca-4165-a553-a26dbc0c6ae8] worker_1 | 2022-09-06T15:57:21.863246Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ddcac0e2-35ca-4165-a553-a26dbc0c6ae8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[437d5375-54e7-45fe-a27b-6b17aa7875ee] worker_1 | 2022-09-06T15:57:22.326315Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=437d5375-54e7-45fe-a27b-6b17aa7875ee worker_1 | Received task: posthog.celery.redis_celery_queue_depth[26e65a7b-13d5-48bd-9dac-80242f6c525f] worker_1 | 2022-09-06T15:57:23.339841Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=26e65a7b-13d5-48bd-9dac-80242f6c525f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[edeee4d3-05cf-4834-8fc7-3b09e0dc081e] worker_1 | 2022-09-06T15:57:24.355527Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=edeee4d3-05cf-4834-8fc7-3b09e0dc081e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[593216ab-62fe-4528-90e7-8e0288890b7c] worker_1 | 2022-09-06T15:57:25.368883Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=593216ab-62fe-4528-90e7-8e0288890b7c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9d1fc871-5f7c-4357-abed-ec9dc10d4074] worker_1 | 2022-09-06T15:57:26.385638Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9d1fc871-5f7c-4357-abed-ec9dc10d4074 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2f0a6ae8-20e5-452d-adac-358c056b104d] worker_1 | 2022-09-06T15:57:27.397725Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2f0a6ae8-20e5-452d-adac-358c056b104d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[44e32f61-a145-43fd-95e0-2bd1e1440832] worker_1 | 2022-09-06T15:57:28.412368Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=44e32f61-a145-43fd-95e0-2bd1e1440832 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[283a51bc-4d35-4118-af55-041c993225b6] worker_1 | 2022-09-06T15:57:29.424306Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=283a51bc-4d35-4118-af55-041c993225b6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[96f0a4e3-6b55-402c-ac8d-71a8e63ff601] worker_1 | 2022-09-06T15:57:30.437768Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=96f0a4e3-6b55-402c-ac8d-71a8e63ff601 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7694abd7-b118-41e1-9a44-a5e982a4c2f8] worker_1 | 2022-09-06T15:57:31.452393Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7694abd7-b118-41e1-9a44-a5e982a4c2f8 worker_1 | Received task: posthog.celery.redis_heartbeat[2e9de02a-834b-4b85-8f09-3460e81632c9] worker_1 | 2022-09-06T15:57:31.865936Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2e9de02a-834b-4b85-8f09-3460e81632c9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[35b255dd-807e-4c10-bc83-965c4dc9040f] worker_1 | 2022-09-06T15:57:32.455331Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=35b255dd-807e-4c10-bc83-965c4dc9040f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[af469c25-34ec-430b-b092-c76b8440cee1] worker_1 | 2022-09-06T15:57:33.470045Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=af469c25-34ec-430b-b092-c76b8440cee1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9ed5b79d-b23d-4434-8981-fff20f0245ec] worker_1 | 2022-09-06T15:57:34.482904Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9ed5b79d-b23d-4434-8981-fff20f0245ec worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f77d4341-2710-4f30-b198-607cc66d137e] worker_1 | 2022-09-06T15:57:35.488377Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f77d4341-2710-4f30-b198-607cc66d137e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9ba69dc2-7aa0-4f9b-82ad-ba0c0c1a37db] worker_1 | 2022-09-06T15:57:36.505179Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9ba69dc2-7aa0-4f9b-82ad-ba0c0c1a37db worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e7e9698f-fef0-426a-8e4b-ff43acdae2df] worker_1 | 2022-09-06T15:57:37.515866Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e7e9698f-fef0-426a-8e4b-ff43acdae2df worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9e399e83-0ea4-49f3-9679-5bf9665e6585] worker_1 | 2022-09-06T15:57:38.531634Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9e399e83-0ea4-49f3-9679-5bf9665e6585 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aa22786e-6478-4b6d-b17f-dec10adca6cc] worker_1 | 2022-09-06T15:57:39.542463Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aa22786e-6478-4b6d-b17f-dec10adca6cc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[323b98fa-52a4-4308-b438-97ec468927c5] worker_1 | 2022-09-06T15:57:40.556186Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=323b98fa-52a4-4308-b438-97ec468927c5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0f52cabc-13af-4be0-ba91-0ea1e6fe5870] worker_1 | 2022-09-06T15:57:41.571561Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0f52cabc-13af-4be0-ba91-0ea1e6fe5870 worker_1 | Received task: posthog.celery.check_cached_items[371c3f0d-a204-4676-a26f-b9c67681a903] worker_1 | 2022-09-06T15:57:41.756077Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=927c0fc6-e268-4478-8aa8-2873777f65ca child_task_name=posthog.celery.update_cache_item_task task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | 2022-09-06T15:57:41.759191Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=6151a7b0-299e-4e5d-8f3c-a7864ab2a4e4 child_task_name=posthog.celery.update_cache_item_task task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | Received task: posthog.celery.update_cache_item_task[927c0fc6-e268-4478-8aa8-2873777f65ca] worker_1 | 2022-09-06T15:57:41.763303Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=64a5a64e-da1f-4302-9674-fc7d635c566c child_task_name=posthog.celery.update_cache_item_task task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | 2022-09-06T15:57:41.766067Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=be65991f-bd2d-41dd-8e8e-df0831e202b1 child_task_name=posthog.celery.update_cache_item_task task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | 2022-09-06T15:57:41.768699Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=44d17fde-c12b-4563-ac63-006ac8a82c88 child_task_name=posthog.celery.update_cache_item_task task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | 2022-09-06T15:57:41.776040Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=371c3f0d-a204-4676-a26f-b9c67681a903 worker_1 | Received task: posthog.celery.update_cache_item_task[6151a7b0-299e-4e5d-8f3c-a7864ab2a4e4] worker_1 | Received task: posthog.celery.update_cache_item_task[64a5a64e-da1f-4302-9674-fc7d635c566c] worker_1 | Received task: posthog.celery.update_cache_item_task[be65991f-bd2d-41dd-8e8e-df0831e202b1] worker_1 | Received task: posthog.celery.update_cache_item_task[44d17fde-c12b-4563-ac63-006ac8a82c88] worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[8bbc74c2-adb1-48ba-95ae-e8ffbe83fd7f] worker_1 | Received task: posthog.celery.redis_heartbeat[6ca24ee6-9d00-41b5-b1d1-795bc2582b82] worker_1 | 2022-09-06T15:57:42.326458Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=6151a7b0-299e-4e5d-8f3c-a7864ab2a4e4 worker_1 | 2022-09-06T15:57:42.396761Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_d8fdb4d9f3b5bc009464e955cba22be4 dashboard_id=9 has_results=True insight_id=49 parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=927c0fc6-e268-4478-8aa8-2873777f65ca worker_1 | 2022-09-06T15:57:42.400890Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=927c0fc6-e268-4478-8aa8-2873777f65ca worker_1 | Received task: posthog.celery.redis_celery_queue_depth[dc10a6d2-b3e8-40e7-8f4d-8dd590bd7664] worker_1 | 2022-09-06T15:57:42.702172Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=64a5a64e-da1f-4302-9674-fc7d635c566c worker_1 | 2022-09-06T15:57:43.316672Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_30ac435eabf651f60c3d662cfe730f6b dashboard_id=9 has_results=True insight_id=24 parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=be65991f-bd2d-41dd-8e8e-df0831e202b1 worker_1 | 2022-09-06T15:57:43.319876Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=be65991f-bd2d-41dd-8e8e-df0831e202b1 worker_1 | 2022-09-06T15:57:43.344533Z [info ] check_clickhouse_schema_drift [posthog.tasks.check_clickhouse_schema_drift] table_count=0 tables=[] task_id=8bbc74c2-adb1-48ba-95ae-e8ffbe83fd7f worker_1 | 2022-09-06T15:57:43.345027Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8bbc74c2-adb1-48ba-95ae-e8ffbe83fd7f worker_1 | 2022-09-06T15:57:43.349010Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6ca24ee6-9d00-41b5-b1d1-795bc2582b82 worker_1 | 2022-09-06T15:57:43.353063Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=dc10a6d2-b3e8-40e7-8f4d-8dd590bd7664 worker_1 | 2022-09-06T15:57:43.408423Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=371c3f0d-a204-4676-a26f-b9c67681a903 task_id=44d17fde-c12b-4563-ac63-006ac8a82c88 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2938972d-67a9-4631-ad83-aa31fc908a0f] worker_1 | 2022-09-06T15:57:43.590341Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2938972d-67a9-4631-ad83-aa31fc908a0f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cfca171a-bb76-4e59-ba9e-f55b1c1605bd] worker_1 | 2022-09-06T15:57:44.608492Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cfca171a-bb76-4e59-ba9e-f55b1c1605bd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[66999b33-097c-4692-8ccb-f0d4d82d7a4f] worker_1 | 2022-09-06T15:57:45.609792Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=66999b33-097c-4692-8ccb-f0d4d82d7a4f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[30f62778-adef-461f-942f-2d0804546857] worker_1 | 2022-09-06T15:57:46.631251Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=30f62778-adef-461f-942f-2d0804546857 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e4c4241b-cc29-4784-8f0e-910b13b9090e] worker_1 | 2022-09-06T15:57:47.638819Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e4c4241b-cc29-4784-8f0e-910b13b9090e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3dda6803-eeb6-47f9-a396-04907e6c7694] worker_1 | 2022-09-06T15:57:48.651866Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3dda6803-eeb6-47f9-a396-04907e6c7694 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[46bc5dc1-7912-4d82-8386-04cfb6dc9c6d] worker_1 | 2022-09-06T15:57:49.661322Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=46bc5dc1-7912-4d82-8386-04cfb6dc9c6d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[512f4a6d-39c7-4caa-aba6-3ea81d76b63a] worker_1 | 2022-09-06T15:57:50.679250Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=512f4a6d-39c7-4caa-aba6-3ea81d76b63a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f9b70fb4-69f4-481a-8564-1acab653d9cf] worker_1 | 2022-09-06T15:57:51.691628Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f9b70fb4-69f4-481a-8564-1acab653d9cf worker_1 | Received task: posthog.celery.redis_heartbeat[7d223460-2004-4ef6-8343-d0b5ad29b1c4] worker_1 | 2022-09-06T15:57:51.887878Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7d223460-2004-4ef6-8343-d0b5ad29b1c4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[48d9b693-e4d9-4156-879c-d53795cb96d3] worker_1 | 2022-09-06T15:57:52.697928Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=48d9b693-e4d9-4156-879c-d53795cb96d3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[711d1491-305c-436a-a98f-022a2fdb754b] worker_1 | 2022-09-06T15:57:53.711634Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=711d1491-305c-436a-a98f-022a2fdb754b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[705d3518-26f2-48bb-91f6-b2873424ca95] worker_1 | 2022-09-06T15:57:54.728445Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=705d3518-26f2-48bb-91f6-b2873424ca95 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ce82f3a8-8700-4cce-9ea5-204f871b1098] worker_1 | 2022-09-06T15:57:55.744373Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ce82f3a8-8700-4cce-9ea5-204f871b1098 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c8eafa12-9788-487f-a030-f110e825cd43] worker_1 | 2022-09-06T15:57:56.756489Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c8eafa12-9788-487f-a030-f110e825cd43 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[53d295c1-d3a5-4e94-a01d-ac5ffabbb7a1] worker_1 | 2022-09-06T15:57:57.768467Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=53d295c1-d3a5-4e94-a01d-ac5ffabbb7a1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7bb6f246-d587-4f89-a312-b1b90360b0d2] worker_1 | 2022-09-06T15:57:58.783254Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7bb6f246-d587-4f89-a312-b1b90360b0d2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1024252c-2d6f-4b38-8536-b9abbdd1afda] worker_1 | 2022-09-06T15:57:59.798111Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1024252c-2d6f-4b38-8536-b9abbdd1afda worker_1 | Received task: posthog.celery.redis_celery_queue_depth[95fdcacc-c3a3-4de1-beb8-7392e56392fb] worker_1 | 2022-09-06T15:58:00.805571Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=95fdcacc-c3a3-4de1-beb8-7392e56392fb worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c8cd24ac-84b4-4251-a67e-6a659c177c3c] worker_1 | 2022-09-06T15:58:01.824484Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c8cd24ac-84b4-4251-a67e-6a659c177c3c worker_1 | Received task: posthog.celery.redis_heartbeat[060d6bf4-d23c-4666-ae0a-34c509576d39] worker_1 | 2022-09-06T15:58:01.891519Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=060d6bf4-d23c-4666-ae0a-34c509576d39 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1e9a83c8-f408-4454-b90e-df1f5ef1b671] worker_1 | 2022-09-06T15:58:02.828620Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1e9a83c8-f408-4454-b90e-df1f5ef1b671 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[843940c9-f558-40ad-b3e2-e0e8a635529c] worker_1 | 2022-09-06T15:58:03.842105Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=843940c9-f558-40ad-b3e2-e0e8a635529c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[51895134-b0e9-46ab-b82a-c9e24d295e22] worker_1 | 2022-09-06T15:58:04.845887Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=51895134-b0e9-46ab-b82a-c9e24d295e22 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8c8aaafe-edb5-4d82-a6da-ac46b4412106] worker_1 | 2022-09-06T15:58:05.862326Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8c8aaafe-edb5-4d82-a6da-ac46b4412106 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[667ed695-6848-4dea-80dd-47ab2f4e839a] worker_1 | 2022-09-06T15:58:06.877705Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=667ed695-6848-4dea-80dd-47ab2f4e839a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5dd1bb52-0929-4aca-a5f0-f1676436b752] worker_1 | 2022-09-06T15:58:07.889521Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5dd1bb52-0929-4aca-a5f0-f1676436b752 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2ff42c1d-7ed8-46be-a0fb-0d36a31f9cdf] worker_1 | 2022-09-06T15:58:08.904466Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2ff42c1d-7ed8-46be-a0fb-0d36a31f9cdf worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b1ae423e-751d-43e2-8622-4fb28298ca65] worker_1 | 2022-09-06T15:58:09.915636Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b1ae423e-751d-43e2-8622-4fb28298ca65 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7052d23e-af2b-4d09-ad56-119cdcf6c0c7] worker_1 | 2022-09-06T15:58:10.924620Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7052d23e-af2b-4d09-ad56-119cdcf6c0c7 worker_1 | Received task: posthog.celery.redis_heartbeat[8de29dd2-c173-4fb0-9c42-1e410a07ce38] worker_1 | 2022-09-06T15:58:11.903206Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8de29dd2-c173-4fb0-9c42-1e410a07ce38 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[204e2d29-8f51-4770-af6d-582821605b34] worker_1 | 2022-09-06T15:58:11.930008Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=204e2d29-8f51-4770-af6d-582821605b34 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d68963b5-e7d0-463e-a51d-755fd568c45a] worker_1 | 2022-09-06T15:58:12.939394Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d68963b5-e7d0-463e-a51d-755fd568c45a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1801e0f1-b240-42ae-a3c6-7adb6c058c8d] worker_1 | 2022-09-06T15:58:13.952856Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1801e0f1-b240-42ae-a3c6-7adb6c058c8d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[48852fc2-e017-4045-a4ba-a3d31f121235] worker_1 | 2022-09-06T15:58:14.967066Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=48852fc2-e017-4045-a4ba-a3d31f121235 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ad4ad82f-bc59-41b4-9992-45dfefef0e82] worker_1 | 2022-09-06T15:58:15.976816Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ad4ad82f-bc59-41b4-9992-45dfefef0e82 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3940956f-d63e-47a7-ab58-9beadaaf810c] worker_1 | 2022-09-06T15:58:16.990643Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3940956f-d63e-47a7-ab58-9beadaaf810c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b133f55c-6107-4749-980f-fc5d6b579a1c] worker_1 | 2022-09-06T15:58:18.004377Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b133f55c-6107-4749-980f-fc5d6b579a1c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[da9704bf-fd88-4790-84e3-3690247fa93d] worker_1 | 2022-09-06T15:58:19.013312Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=da9704bf-fd88-4790-84e3-3690247fa93d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[09cddff9-d24d-4155-ac16-972a8e08e918] worker_1 | 2022-09-06T15:58:20.026996Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=09cddff9-d24d-4155-ac16-972a8e08e918 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e93c2508-c7a4-4c92-9b2e-79114b2c3a48] worker_1 | 2022-09-06T15:58:21.047360Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e93c2508-c7a4-4c92-9b2e-79114b2c3a48 worker_1 | Received task: posthog.celery.redis_heartbeat[fcbd191d-2516-4479-8004-064557eaf377] worker_1 | 2022-09-06T15:58:21.911493Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fcbd191d-2516-4479-8004-064557eaf377 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fc978211-ed3a-4e5f-ba0f-4f1c9bf1433e] worker_1 | 2022-09-06T15:58:22.054478Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fc978211-ed3a-4e5f-ba0f-4f1c9bf1433e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5c472fd7-1060-4e3b-ad63-3dce5cb4c9ae] worker_1 | 2022-09-06T15:58:23.062121Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5c472fd7-1060-4e3b-ad63-3dce5cb4c9ae worker_1 | Received task: posthog.celery.redis_celery_queue_depth[013bea4b-3d38-483e-94b4-08a61979fb8b] worker_1 | 2022-09-06T15:58:24.075334Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=013bea4b-3d38-483e-94b4-08a61979fb8b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2010fc0a-0138-4a2b-a951-c49a2b272c63] worker_1 | 2022-09-06T15:58:25.087581Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2010fc0a-0138-4a2b-a951-c49a2b272c63 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6362cb84-8c4c-4a89-ae81-8413c8463265] worker_1 | 2022-09-06T15:58:26.092900Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6362cb84-8c4c-4a89-ae81-8413c8463265 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[24edcdee-daf2-4aa3-b64b-b0712e046702] worker_1 | 2022-09-06T15:58:27.114446Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=24edcdee-daf2-4aa3-b64b-b0712e046702 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6d0d0f23-71fa-4221-9ffa-bb01b896d0f1] worker_1 | 2022-09-06T15:58:28.122472Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6d0d0f23-71fa-4221-9ffa-bb01b896d0f1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7f6c5ef1-bbcb-4caf-9761-9abaa0794c18] worker_1 | 2022-09-06T15:58:29.134803Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7f6c5ef1-bbcb-4caf-9761-9abaa0794c18 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e5b824d0-7cf1-49fe-a894-6a83e241b029] worker_1 | 2022-09-06T15:58:30.145120Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e5b824d0-7cf1-49fe-a894-6a83e241b029 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ee3de4c3-1cab-4983-a8ea-a360ba2068cf] worker_1 | 2022-09-06T15:58:31.174777Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ee3de4c3-1cab-4983-a8ea-a360ba2068cf worker_1 | Received task: posthog.celery.redis_heartbeat[3494bb81-0e58-41de-9127-c3584599e4e6] worker_1 | 2022-09-06T15:58:31.918973Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3494bb81-0e58-41de-9127-c3584599e4e6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ac4067b5-0948-4447-a23f-31e221e6e74a] worker_1 | 2022-09-06T15:58:32.188469Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ac4067b5-0948-4447-a23f-31e221e6e74a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[96f567e2-7ca6-466e-9067-7713c6af46bd] worker_1 | 2022-09-06T15:58:33.195207Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=96f567e2-7ca6-466e-9067-7713c6af46bd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8a70536c-ee8e-4630-ad46-2706ef044c6b] worker_1 | 2022-09-06T15:58:34.203894Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8a70536c-ee8e-4630-ad46-2706ef044c6b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[34e794c5-209e-45f2-b94e-c31ea9215844] worker_1 | 2022-09-06T15:58:35.213692Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=34e794c5-209e-45f2-b94e-c31ea9215844 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1ac7a275-17bb-4d63-a1fb-ed7fb88a093e] worker_1 | 2022-09-06T15:58:36.222063Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1ac7a275-17bb-4d63-a1fb-ed7fb88a093e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[eff0c1ff-1659-47c5-bd90-a6543941aac0] worker_1 | 2022-09-06T15:58:37.236917Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=eff0c1ff-1659-47c5-bd90-a6543941aac0 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0c5a3d57-e35e-4fe3-9701-936f4373af56] worker_1 | 2022-09-06T15:58:38.259194Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0c5a3d57-e35e-4fe3-9701-936f4373af56 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ebdda9ae-3c45-4a04-b971-922049326c00] worker_1 | 2022-09-06T15:58:39.275596Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ebdda9ae-3c45-4a04-b971-922049326c00 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[22b82308-5fba-4972-9c3a-0299597e6998] worker_1 | 2022-09-06T15:58:40.284673Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=22b82308-5fba-4972-9c3a-0299597e6998 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c9547f60-2ee2-499d-b896-4265918d2e80] worker_1 | 2022-09-06T15:58:41.307006Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c9547f60-2ee2-499d-b896-4265918d2e80 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[339f5cc2-88a0-495c-963d-cde67e84a2dd] worker_1 | 2022-09-06T15:58:41.890584Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=339f5cc2-88a0-495c-963d-cde67e84a2dd worker_1 | Received task: posthog.celery.redis_heartbeat[6b1495ac-3af4-453c-b4af-8f82b23f126f] worker_1 | 2022-09-06T15:58:41.924614Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6b1495ac-3af4-453c-b4af-8f82b23f126f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4f41f2dd-8c23-4340-a7f4-ac5e451107ea] worker_1 | 2022-09-06T15:58:42.308434Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4f41f2dd-8c23-4340-a7f4-ac5e451107ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[009aac6e-7f87-4c10-810e-bbbb1304ff0b] worker_1 | 2022-09-06T15:58:43.323255Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=009aac6e-7f87-4c10-810e-bbbb1304ff0b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5ed12973-8c40-4486-8018-eda22e972abf] worker_1 | 2022-09-06T15:58:44.334628Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5ed12973-8c40-4486-8018-eda22e972abf worker_1 | Received task: posthog.celery.redis_celery_queue_depth[882b7794-0625-4765-9285-8b7350289920] worker_1 | 2022-09-06T15:58:45.345352Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=882b7794-0625-4765-9285-8b7350289920 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[46ebd1d7-b28e-4ca9-8e5a-20778bd36237] worker_1 | 2022-09-06T15:58:46.359345Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=46ebd1d7-b28e-4ca9-8e5a-20778bd36237 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[45f5d375-58a2-43d3-94e3-9b75b68218d5] worker_1 | 2022-09-06T15:58:47.366899Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=45f5d375-58a2-43d3-94e3-9b75b68218d5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c4a4369e-4d69-489d-b208-177ef2962ad8] worker_1 | 2022-09-06T15:58:48.378823Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c4a4369e-4d69-489d-b208-177ef2962ad8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[642e5ad6-cc17-44d8-9c1b-ae58b8620ce6] worker_1 | 2022-09-06T15:58:49.393888Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=642e5ad6-cc17-44d8-9c1b-ae58b8620ce6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c03d2be8-ba44-4e92-adc7-01137956adf7] worker_1 | 2022-09-06T15:58:50.397090Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c03d2be8-ba44-4e92-adc7-01137956adf7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[86985e9c-b6e1-40cf-a5b1-e2c8e71d4843] worker_1 | 2022-09-06T15:58:51.412400Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=86985e9c-b6e1-40cf-a5b1-e2c8e71d4843 worker_1 | Received task: posthog.celery.redis_heartbeat[dcc22f00-8a30-4678-a0b4-23ddc92993ae] worker_1 | 2022-09-06T15:58:51.934298Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=dcc22f00-8a30-4678-a0b4-23ddc92993ae worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9a5283d3-b1d2-4eb4-b977-5555de3432f1] worker_1 | 2022-09-06T15:58:52.421446Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9a5283d3-b1d2-4eb4-b977-5555de3432f1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ad8f58b9-8953-4a2e-beef-e4ec2069db5a] worker_1 | 2022-09-06T15:58:53.435958Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ad8f58b9-8953-4a2e-beef-e4ec2069db5a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[070387c0-ba04-425a-a4cc-70497c2538ec] worker_1 | 2022-09-06T15:58:54.448101Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=070387c0-ba04-425a-a4cc-70497c2538ec worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2293e037-6be2-4e0b-a80b-3f8ad29685fd] worker_1 | 2022-09-06T15:58:55.461500Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2293e037-6be2-4e0b-a80b-3f8ad29685fd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ca2315cb-0887-4bab-b726-703de7ad1ea2] worker_1 | 2022-09-06T15:58:56.474340Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ca2315cb-0887-4bab-b726-703de7ad1ea2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[03d49090-617a-427a-b19e-4444cab0f713] worker_1 | 2022-09-06T15:58:57.486828Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=03d49090-617a-427a-b19e-4444cab0f713 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[46dd88f8-3e8c-472c-834e-5853199ab781] worker_1 | 2022-09-06T15:58:58.500504Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=46dd88f8-3e8c-472c-834e-5853199ab781 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d546a408-aaa0-4afd-83dd-e18581a73e65] worker_1 | 2022-09-06T15:58:59.512291Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d546a408-aaa0-4afd-83dd-e18581a73e65 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5fef27a4-0a8a-4db6-8e38-6bde8d41fa32] worker_1 | 2022-09-06T15:59:00.525296Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5fef27a4-0a8a-4db6-8e38-6bde8d41fa32 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[47459064-2678-4d2f-ba7d-25cf8096ea31] worker_1 | 2022-09-06T15:59:01.536938Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=47459064-2678-4d2f-ba7d-25cf8096ea31 worker_1 | Received task: posthog.celery.graphile_queue_size[86fca513-a7aa-4695-87f7-aa0f52275cc0] worker_1 | 2022-09-06T15:59:01.657604Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=86fca513-a7aa-4695-87f7-aa0f52275cc0 worker_1 | Received task: posthog.celery.pg_table_cache_hit_rate[4be9fe87-3758-466e-b215-13a126ddc64a] worker_1 | 2022-09-06T15:59:01.691085Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4be9fe87-3758-466e-b215-13a126ddc64a worker_1 | Received task: posthog.celery.redis_heartbeat[42cdfd37-435c-4790-bbf1-0a60d2b8fa50] worker_1 | 2022-09-06T15:59:01.955314Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=42cdfd37-435c-4790-bbf1-0a60d2b8fa50 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fbb3bdad-58f1-4e74-ad05-16f63b71896f] worker_1 | 2022-09-06T15:59:02.546209Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fbb3bdad-58f1-4e74-ad05-16f63b71896f worker_1 | Received task: posthog.celery.clickhouse_row_count[84cdf462-5eee-425d-9cc4-9afc9098573e] worker_1 | 2022-09-06T15:59:02.727347Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=84cdf462-5eee-425d-9cc4-9afc9098573e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5e72e6aa-9ab8-475e-8009-113b4c2c0f05] worker_1 | 2022-09-06T15:59:03.555031Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5e72e6aa-9ab8-475e-8009-113b4c2c0f05 worker_1 | Received task: posthog.celery.clickhouse_lag[e2b30c4f-12ba-4bb2-9376-11798b0d2e65] worker_1 | 2022-09-06T15:59:03.715962Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e2b30c4f-12ba-4bb2-9376-11798b0d2e65 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c0be3375-d9eb-4962-8201-d66729e74277] worker_1 | 2022-09-06T15:59:04.562536Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c0be3375-d9eb-4962-8201-d66729e74277 worker_1 | Received task: posthog.celery.clickhouse_mutation_count[c06e5364-c7a8-4a6b-9e48-0b4fd106b4a0] worker_1 | 2022-09-06T15:59:04.634498Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c06e5364-c7a8-4a6b-9e48-0b4fd106b4a0 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[84aa9efc-ab4f-407a-ad01-f28d7e6060f7] worker_1 | 2022-09-06T15:59:05.581322Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=84aa9efc-ab4f-407a-ad01-f28d7e6060f7 worker_1 | Received task: posthog.celery.clickhouse_part_count[2cf5c5dd-9473-480c-85b0-dcc78081c547] worker_1 | 2022-09-06T15:59:05.655962Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2cf5c5dd-9473-480c-85b0-dcc78081c547 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[19874002-0be6-41a3-8960-f5c19e383f42] worker_1 | Received task: posthog.celery.calculate_cohort[e0a947ba-2586-419f-87e2-85bd20f72a91] worker_1 | 2022-09-06T15:59:06.735588Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=19874002-0be6-41a3-8960-f5c19e383f42 worker_1 | 2022-09-06T15:59:06.747483Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e0a947ba-2586-419f-87e2-85bd20f72a91 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[043f7c9d-a81c-4012-a4d2-a096be9851e6] worker_1 | 2022-09-06T15:59:07.746827Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=043f7c9d-a81c-4012-a4d2-a096be9851e6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c28af76c-5340-47fe-82fd-7ae29055242b] worker_1 | 2022-09-06T15:59:08.762244Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c28af76c-5340-47fe-82fd-7ae29055242b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a8f08d1e-ac71-4f4d-a730-94de2faa5fcb] worker_1 | 2022-09-06T15:59:09.780967Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a8f08d1e-ac71-4f4d-a730-94de2faa5fcb worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6d141052-d701-4e8e-b918-c637c8b17c3c] worker_1 | 2022-09-06T15:59:10.788576Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6d141052-d701-4e8e-b918-c637c8b17c3c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fd921a39-8d30-4c25-bd01-9cac14cab356] worker_1 | Received task: posthog.celery.check_cached_items[13d913b0-dbd1-43ca-bbab-80e2fae06421] worker_1 | 2022-09-06T15:59:11.806619Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fd921a39-8d30-4c25-bd01-9cac14cab356 worker_1 | 2022-09-06T15:59:11.918710Z [info ] update_cache_queue.seen_ages [posthog.tasks.update_cache] ages=[{'insight_id': 51, 'dashboard_id': 9, 'cache_key': 'cache_c460968d824fa115ae573fad966e8b2d', 'age': 360}, {'insight_id': 27, 'dashboard_id': 9, 'cache_key': 'cache_e7ade05125231cf6c91ef9ace61292d9', 'age': 359}, {'insight_id': 46, 'dashboard_id': 8, 'cache_key': 'cache_94eede2286d303dac8eb3560a9c815f2', 'age': 358}, {'insight_id': 45, 'dashboard_id': 8, 'cache_key': 'cache_488ec0c130ba3da85f2842dd19edfc30', 'age': 358}, {'insight_id': 52, 'dashboard_id': 9, 'cache_key': 'cache_6ae5d4c58c4b69bc410044e87afd3c5a', 'age': 357}, {'insight_id': 21, 'dashboard_id': 4, 'cache_key': 'cache_2f475ea610216844359d02fb8ad0de91', 'age': 269}, {'insight_id': 23, 'dashboard_id': 4, 'cache_key': 'cache_554716c78686a18b5d1d90f1ada98da7', 'age': 269}, {'insight_id': 42, 'dashboard_id': 8, 'cache_key': 'cache_b25750a83ecfb7331ea0167ea492bfa1', 'age': 269}, {'insight_id': 20, 'dashboard_id': 4, 'cache_key': 'cache_21e1f6b32529220e778855aec568ceee', 'age': 268}, {'insight_id': 22, 'dashboard_id': 4, 'cache_key': 'cache_2b2821c1a13afc53a5c6bc450f47ff16', 'age': 268}] task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | Received task: posthog.celery.redis_heartbeat[2f0aa8f2-84c2-4f48-966f-7eb1e28d4fff] worker_1 | 2022-09-06T15:59:11.962754Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2f0aa8f2-84c2-4f48-966f-7eb1e28d4fff worker_1 | 2022-09-06T15:59:11.973630Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=32163f27-fb8f-42a4-9965-a8ee4e1352a1 child_task_name=posthog.celery.update_cache_item_task task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | 2022-09-06T15:59:11.977981Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=28eadbc6-84f5-471a-b9d5-74aa589bce24 child_task_name=posthog.celery.update_cache_item_task task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | 2022-09-06T15:59:11.982437Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=2a197843-22a2-4eea-a9dc-8e624524d6b2 child_task_name=posthog.celery.update_cache_item_task task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | 2022-09-06T15:59:11.986381Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=3651d9c3-d91f-476e-99f8-4c228aeaf03e child_task_name=posthog.celery.update_cache_item_task task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | 2022-09-06T15:59:11.990955Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=b1daa9d3-55e4-44d5-962f-6547a07190c8 child_task_name=posthog.celery.update_cache_item_task task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | Received task: posthog.celery.update_cache_item_task[32163f27-fb8f-42a4-9965-a8ee4e1352a1] worker_1 | 2022-09-06T15:59:11.999733Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 worker_1 | Received task: posthog.celery.update_cache_item_task[28eadbc6-84f5-471a-b9d5-74aa589bce24] worker_1 | Received task: posthog.celery.update_cache_item_task[2a197843-22a2-4eea-a9dc-8e624524d6b2] worker_1 | Received task: posthog.celery.update_cache_item_task[3651d9c3-d91f-476e-99f8-4c228aeaf03e] worker_1 | Received task: posthog.celery.update_cache_item_task[b1daa9d3-55e4-44d5-962f-6547a07190c8] worker_1 | 2022-09-06T15:59:12.566238Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=32163f27-fb8f-42a4-9965-a8ee4e1352a1 worker_1 | 2022-09-06T15:59:12.674312Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=2a197843-22a2-4eea-a9dc-8e624524d6b2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6037a61d-7b39-4aca-8b1a-795610a5611c] worker_1 | 2022-09-06T15:59:12.929078Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=3651d9c3-d91f-476e-99f8-4c228aeaf03e worker_1 | 2022-09-06T15:59:12.940894Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_e7ade05125231cf6c91ef9ace61292d9 dashboard_id=9 has_results=True insight_id=27 parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=28eadbc6-84f5-471a-b9d5-74aa589bce24 worker_1 | 2022-09-06T15:59:12.945071Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=28eadbc6-84f5-471a-b9d5-74aa589bce24 worker_1 | 2022-09-06T15:59:12.948479Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6037a61d-7b39-4aca-8b1a-795610a5611c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fb5782ec-1de7-4e98-ade4-bc4d5d894c1d] worker_1 | 2022-09-06T15:59:13.817307Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fb5782ec-1de7-4e98-ade4-bc4d5d894c1d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[73d6c12e-0748-4816-9333-c54e76d59b24] worker_1 | 2022-09-06T15:59:14.823593Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=73d6c12e-0748-4816-9333-c54e76d59b24 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[94e17ff4-e85a-4475-96de-c31a15bc57d2] worker_1 | 2022-09-06T15:59:15.847521Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=94e17ff4-e85a-4475-96de-c31a15bc57d2 worker_1 | 2022-09-06T15:59:16.230976Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=13d913b0-dbd1-43ca-bbab-80e2fae06421 task_id=b1daa9d3-55e4-44d5-962f-6547a07190c8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[502f0cc7-dcb9-4f91-96ef-2e2171365b93] worker_1 | 2022-09-06T15:59:16.860810Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=502f0cc7-dcb9-4f91-96ef-2e2171365b93 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[25a7860d-c456-4ff3-b296-451dc4ecaebd] worker_1 | 2022-09-06T15:59:17.877252Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=25a7860d-c456-4ff3-b296-451dc4ecaebd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[860368d2-484c-4320-a610-239b10731316] worker_1 | 2022-09-06T15:59:18.888671Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=860368d2-484c-4320-a610-239b10731316 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d89e4ba0-31dc-4311-a516-d90d618cc581] worker_1 | 2022-09-06T15:59:19.900981Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d89e4ba0-31dc-4311-a516-d90d618cc581 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7d3f4f4e-cf32-4e75-8e31-feced689a127] worker_1 | 2022-09-06T15:59:20.916797Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7d3f4f4e-cf32-4e75-8e31-feced689a127 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9efafe73-2482-4a19-bfa2-c5422b434fa2] worker_1 | 2022-09-06T15:59:21.930133Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9efafe73-2482-4a19-bfa2-c5422b434fa2 worker_1 | Received task: posthog.celery.redis_heartbeat[c073c17d-a5fc-4502-9c90-dc168d550403] worker_1 | 2022-09-06T15:59:21.969591Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c073c17d-a5fc-4502-9c90-dc168d550403 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[edf42baa-cf6a-4083-a9cd-f0c0ddbcdd59] worker_1 | 2022-09-06T15:59:22.943673Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=edf42baa-cf6a-4083-a9cd-f0c0ddbcdd59 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[01dbf922-d142-4ef2-80f4-fa537eefec9f] worker_1 | 2022-09-06T15:59:23.955575Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=01dbf922-d142-4ef2-80f4-fa537eefec9f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a5ab12d8-02e7-43e3-94ae-fb430af7da1f] worker_1 | 2022-09-06T15:59:24.966655Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a5ab12d8-02e7-43e3-94ae-fb430af7da1f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b4c17abc-cd81-471c-8609-b367d5b6e435] worker_1 | 2022-09-06T15:59:25.978457Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b4c17abc-cd81-471c-8609-b367d5b6e435 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5f5485a4-89d8-4037-9188-71fe4856f795] worker_1 | 2022-09-06T15:59:26.987498Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5f5485a4-89d8-4037-9188-71fe4856f795 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4fac913c-c87f-401c-8628-1245d67aa0e1] worker_1 | 2022-09-06T15:59:28.000761Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4fac913c-c87f-401c-8628-1245d67aa0e1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[67db0100-db58-417e-8c03-03a7cc2c6a4f] worker_1 | 2022-09-06T15:59:29.010896Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=67db0100-db58-417e-8c03-03a7cc2c6a4f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5cce6373-987a-4514-8578-99c943cb9560] worker_1 | 2022-09-06T15:59:30.027993Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5cce6373-987a-4514-8578-99c943cb9560 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[27949daf-a4fe-44cc-9345-34620a7c3981] worker_1 | 2022-09-06T15:59:31.055305Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=27949daf-a4fe-44cc-9345-34620a7c3981 worker_1 | Received task: posthog.celery.redis_heartbeat[c0800571-9062-4882-9827-209898f74f18] worker_1 | 2022-09-06T15:59:31.976375Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c0800571-9062-4882-9827-209898f74f18 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4fdaab46-3e05-4214-9d15-3efe229f46a7] worker_1 | 2022-09-06T15:59:32.051964Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4fdaab46-3e05-4214-9d15-3efe229f46a7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[dbf4bceb-491f-40d8-9c30-d10df5fee8c6] worker_1 | 2022-09-06T15:59:33.061223Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=dbf4bceb-491f-40d8-9c30-d10df5fee8c6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aafa7ba3-4178-48f2-a471-323326012df2] worker_1 | 2022-09-06T15:59:34.065512Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aafa7ba3-4178-48f2-a471-323326012df2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[29ccb291-3ca1-46b8-9a0f-9abc066c1ea3] worker_1 | 2022-09-06T15:59:35.074258Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=29ccb291-3ca1-46b8-9a0f-9abc066c1ea3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[541fb7fb-7f7c-43cd-acaa-f70854279a37] worker_1 | 2022-09-06T15:59:36.089317Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=541fb7fb-7f7c-43cd-acaa-f70854279a37 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[95188786-62a1-4c95-b9f2-84a4e6545f8a] worker_1 | 2022-09-06T15:59:37.098426Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=95188786-62a1-4c95-b9f2-84a4e6545f8a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cb0dd420-baba-4d41-985d-2241b728af42] worker_1 | 2022-09-06T15:59:38.108308Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cb0dd420-baba-4d41-985d-2241b728af42 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b541dbec-7d6f-45a5-92e1-6f026a206fe9] worker_1 | 2022-09-06T15:59:39.122231Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b541dbec-7d6f-45a5-92e1-6f026a206fe9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ec6dd79a-1eb1-4394-a88a-a4d16a6040d2] worker_1 | 2022-09-06T15:59:40.135774Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ec6dd79a-1eb1-4394-a88a-a4d16a6040d2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[96619d0d-a06b-4ad1-80ec-3febceb6b657] worker_1 | 2022-09-06T15:59:41.154089Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=96619d0d-a06b-4ad1-80ec-3febceb6b657 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[81755ad8-95a8-4a35-8e3f-a89b27d93b08] worker_1 | 2022-09-06T15:59:41.905980Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=81755ad8-95a8-4a35-8e3f-a89b27d93b08 worker_1 | Received task: posthog.celery.redis_heartbeat[fd9d8e6b-922f-49cb-97f3-150d0ea5993f] worker_1 | 2022-09-06T15:59:41.990569Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fd9d8e6b-922f-49cb-97f3-150d0ea5993f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f13097d9-5ebe-42c9-aaba-5eac4ba00f9f] worker_1 | 2022-09-06T15:59:42.150241Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f13097d9-5ebe-42c9-aaba-5eac4ba00f9f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[465e0a15-2628-4b73-ba22-58719880e074] worker_1 | 2022-09-06T15:59:43.178853Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=465e0a15-2628-4b73-ba22-58719880e074 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b1302c54-b53d-408b-a7f3-c35e83337dde] worker_1 | 2022-09-06T15:59:44.196031Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b1302c54-b53d-408b-a7f3-c35e83337dde worker_1 | Received task: posthog.celery.redis_celery_queue_depth[18dff06a-96cb-415e-a446-693bdf313b2e] worker_1 | 2022-09-06T15:59:45.208012Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=18dff06a-96cb-415e-a446-693bdf313b2e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8c7137d1-1ce2-476d-97a8-4d6dc0feee00] worker_1 | 2022-09-06T15:59:46.216935Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8c7137d1-1ce2-476d-97a8-4d6dc0feee00 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c982008f-21bb-48a5-b531-59ce6b44b68a] worker_1 | 2022-09-06T15:59:47.234184Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c982008f-21bb-48a5-b531-59ce6b44b68a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d67cbb61-b57c-4174-94f1-34a36ea55bdf] worker_1 | 2022-09-06T15:59:48.249247Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d67cbb61-b57c-4174-94f1-34a36ea55bdf worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f56358fc-a751-4f80-90f1-20c6e02d8568] worker_1 | 2022-09-06T15:59:49.269470Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f56358fc-a751-4f80-90f1-20c6e02d8568 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[dfb6b808-450f-459d-b495-96592e81a260] worker_1 | 2022-09-06T15:59:50.285724Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=dfb6b808-450f-459d-b495-96592e81a260 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1de7d672-3f13-446b-9e1c-f395e472e828] worker_1 | 2022-09-06T15:59:51.306729Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1de7d672-3f13-446b-9e1c-f395e472e828 worker_1 | Received task: posthog.celery.redis_heartbeat[af794037-8c9b-406c-ac54-62f14805c110] worker_1 | 2022-09-06T15:59:52.002908Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=af794037-8c9b-406c-ac54-62f14805c110 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[41b17eb0-d01c-4a56-b0f6-8ba6d4db44ab] worker_1 | 2022-09-06T15:59:52.306144Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=41b17eb0-d01c-4a56-b0f6-8ba6d4db44ab worker_1 | Received task: posthog.celery.redis_celery_queue_depth[580b2ee6-de55-433c-af06-531fe5af2b91] worker_1 | 2022-09-06T15:59:53.319469Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=580b2ee6-de55-433c-af06-531fe5af2b91 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f513b88e-4e15-4a4c-a8df-b5689b66e857] worker_1 | 2022-09-06T15:59:54.333933Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f513b88e-4e15-4a4c-a8df-b5689b66e857 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[400bf427-65ac-4a85-814a-206a7063b3d3] worker_1 | 2022-09-06T15:59:55.356120Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=400bf427-65ac-4a85-814a-206a7063b3d3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fc82298b-ab25-4d4f-9ac7-0180ae93170d] worker_1 | 2022-09-06T15:59:56.372402Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fc82298b-ab25-4d4f-9ac7-0180ae93170d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[43e0c2d9-b7fd-4e68-81bb-14b2fc1adec9] worker_1 | 2022-09-06T15:59:57.381231Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=43e0c2d9-b7fd-4e68-81bb-14b2fc1adec9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5f77f4b1-e618-4c63-83d5-176593b6ab1d] worker_1 | 2022-09-06T15:59:58.394468Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5f77f4b1-e618-4c63-83d5-176593b6ab1d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aedd3c38-a1cc-4b4c-aba0-1a119e3b59c4] worker_1 | 2022-09-06T15:59:59.411720Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aedd3c38-a1cc-4b4c-aba0-1a119e3b59c4 worker_1 | Received task: posthog.celery.pg_plugin_server_query_timing[8f56f3f4-e38b-4d11-85cc-590509dd08ac] worker_1 | Received task: posthog.celery.clickhouse_mark_all_materialized[22df2179-7029-42d4-8234-f554f2b15816] db_1 | 2022-09-06 16:00:00.039 UTC [439] ERROR: relation "pg_stat_statements" does not exist at character 395 db_1 | 2022-09-06 16:00:00.039 UTC [439] STATEMENT: db_1 | SELECT db_1 | substring(query from 'plugin-server:(\w+)') AS query_type, db_1 | total_time as total_time, db_1 | (total_time / calls) as avg_time, db_1 | min_time, db_1 | max_time, db_1 | stddev_time, db_1 | calls, db_1 | rows as rows_read_or_affected db_1 | FROM pg_stat_statements db_1 | WHERE query LIKE '%%plugin-server%%' db_1 | ORDER BY total_time DESC db_1 | LIMIT 50 db_1 | worker_1 | 2022-09-06T16:00:00.052732Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8f56f3f4-e38b-4d11-85cc-590509dd08ac worker_1 | Received task: posthog.celery.calculate_cohort_ids_in_feature_flags_task[0258058a-6f29-4730-910f-65a2e70f5b24] worker_1 | Received task: posthog.celery.check_async_migration_health[59d21922-32ed-4b2a-9337-bb46ce02da56] worker_1 | 2022-09-06T16:00:00.091268Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0258058a-6f29-4730-910f-65a2e70f5b24 worker_1 | 2022-09-06T16:00:00.110446Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=59d21922-32ed-4b2a-9337-bb46ce02da56 plugins_1 | 2022-09-06T16:00:00.164Z [info] (MAIN) ⏲ Performing periodic MMDB staleness check... [/code/plugin-server/dist/main/services/mmdb.js:147] logId=01831387-a4a4-0000-d7f9-185d0ae9d4ea plugins_1 | 2022-09-06T16:00:00.161Z [info] (___1) 🍿 Fetched all actions from DB anew [/code/plugin-server/dist/worker/ingestion/action-manager.js:29] logId=01831387-a4a1-0000-4592-b5722e3b4c99 plugins_1 | 2022-09-06T16:00:00.170Z [info] (___2) 🍿 Fetched all actions from DB anew [/code/plugin-server/dist/worker/ingestion/action-manager.js:29] logId=01831387-a4aa-0000-aae0-1d8d9ed7349f worker_1 | 2022-09-06T16:00:00.214397Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=22df2179-7029-42d4-8234-f554f2b15816 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[74bd0d30-f1e0-40ab-94e1-514625541259] worker_1 | 2022-09-06T16:00:00.414888Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=74bd0d30-f1e0-40ab-94e1-514625541259 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ef705a4f-ad16-45c2-bc53-090e07026949] worker_1 | 2022-09-06T16:00:01.429703Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ef705a4f-ad16-45c2-bc53-090e07026949 plugins_1 | 2022-09-06T16:00:01.582Z [info] (MAIN) ❎ MMDB staleness check completed, no update was needed [/code/plugin-server/dist/main/services/mmdb.js:153] logId=01831387-aa1e-0000-e49b-447735a31eec worker_1 | Received task: posthog.celery.redis_heartbeat[9a830bb0-a8bb-4c06-90d6-72bacfa7a792] worker_1 | 2022-09-06T16:00:01.999760Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9a830bb0-a8bb-4c06-90d6-72bacfa7a792 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fd46fbaf-667c-4ad7-a646-7116cec18ad5] worker_1 | 2022-09-06T16:00:02.434215Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fd46fbaf-667c-4ad7-a646-7116cec18ad5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ec313c43-0684-486d-89bb-63c3681187a1] worker_1 | 2022-09-06T16:00:03.447283Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ec313c43-0684-486d-89bb-63c3681187a1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bb44f1a7-d830-4357-b113-6fb36e0c4e92] worker_1 | 2022-09-06T16:00:04.455578Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bb44f1a7-d830-4357-b113-6fb36e0c4e92 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[477261ac-064b-4806-a622-cfc10956e244] worker_1 | 2022-09-06T16:00:05.462773Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=477261ac-064b-4806-a622-cfc10956e244 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1cb62e8f-2170-483d-afec-ada2458776d3] worker_1 | 2022-09-06T16:00:06.472976Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1cb62e8f-2170-483d-afec-ada2458776d3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e1b0b7f8-af08-4ce9-9fa9-5bcaba783c7b] worker_1 | 2022-09-06T16:00:07.487107Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e1b0b7f8-af08-4ce9-9fa9-5bcaba783c7b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8800c82c-4b44-40dc-a416-f289fa799003] worker_1 | 2022-09-06T16:00:08.497534Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8800c82c-4b44-40dc-a416-f289fa799003 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2c6ab0cd-adb5-4693-abd6-f0916e6ee303] worker_1 | 2022-09-06T16:00:09.507487Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2c6ab0cd-adb5-4693-abd6-f0916e6ee303 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[546ae206-29fe-4e89-bda4-0186001f2d77] worker_1 | 2022-09-06T16:00:10.515000Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=546ae206-29fe-4e89-bda4-0186001f2d77 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f81d26f3-8ce6-4c7a-b948-9d1ed27b3511] worker_1 | 2022-09-06T16:00:11.530276Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f81d26f3-8ce6-4c7a-b948-9d1ed27b3511 worker_1 | Received task: posthog.celery.redis_heartbeat[6777f5f6-0609-4193-b3ee-be1dae4ca8bc] worker_1 | 2022-09-06T16:00:12.008949Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6777f5f6-0609-4193-b3ee-be1dae4ca8bc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c621d8af-b674-4bc3-aa84-c59757cde9d3] worker_1 | 2022-09-06T16:00:12.537176Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c621d8af-b674-4bc3-aa84-c59757cde9d3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bf93cd5e-98cb-4fe8-afb3-d0343c154355] worker_1 | 2022-09-06T16:00:13.543266Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bf93cd5e-98cb-4fe8-afb3-d0343c154355 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cac67618-dd81-44b7-a747-da5ae1a704e9] worker_1 | 2022-09-06T16:00:14.558010Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cac67618-dd81-44b7-a747-da5ae1a704e9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[eec5671a-2106-4d93-8df6-61d5cf39f005] worker_1 | 2022-09-06T16:00:15.572953Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=eec5671a-2106-4d93-8df6-61d5cf39f005 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[475050af-f585-47ec-b3da-a902425b893e] worker_1 | 2022-09-06T16:00:16.581985Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=475050af-f585-47ec-b3da-a902425b893e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9a8d5aec-41f4-4946-ac8f-33ed8b88253f] worker_1 | 2022-09-06T16:00:17.590618Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9a8d5aec-41f4-4946-ac8f-33ed8b88253f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[253d6657-4690-4169-8cc0-fec4951165c1] worker_1 | 2022-09-06T16:00:18.601948Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=253d6657-4690-4169-8cc0-fec4951165c1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e77ab206-db4d-42b4-a6f9-eb6aff2f2577] worker_1 | 2022-09-06T16:00:19.614794Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e77ab206-db4d-42b4-a6f9-eb6aff2f2577 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[294157f6-bea1-4271-b10c-faf62f78da60] worker_1 | 2022-09-06T16:00:20.626002Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=294157f6-bea1-4271-b10c-faf62f78da60 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[394154dd-89e0-41c6-ae82-1228eb031bd3] worker_1 | 2022-09-06T16:00:21.642812Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=394154dd-89e0-41c6-ae82-1228eb031bd3 worker_1 | Received task: posthog.celery.redis_heartbeat[b94b294c-cfcb-4507-82b6-320d29c329b4] worker_1 | 2022-09-06T16:00:22.010794Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b94b294c-cfcb-4507-82b6-320d29c329b4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[50350e92-2384-4323-a3ae-27d391864b54] worker_1 | 2022-09-06T16:00:22.639344Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=50350e92-2384-4323-a3ae-27d391864b54 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cb214042-1c11-4242-8065-99cffca151fa] worker_1 | 2022-09-06T16:00:23.651952Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cb214042-1c11-4242-8065-99cffca151fa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e88aba9b-9371-43e6-8d9e-473aa05253e4] worker_1 | 2022-09-06T16:00:24.664321Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e88aba9b-9371-43e6-8d9e-473aa05253e4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5a0e5b7a-69c6-4cbb-a0b8-a9e7cf0da334] worker_1 | 2022-09-06T16:00:25.676356Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5a0e5b7a-69c6-4cbb-a0b8-a9e7cf0da334 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2741027a-9bb1-49ff-8e40-e9c9f3eb7ffc] worker_1 | 2022-09-06T16:00:26.685799Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2741027a-9bb1-49ff-8e40-e9c9f3eb7ffc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[765b8305-6471-4e3e-913f-b779ad1dbd4c] worker_1 | 2022-09-06T16:00:27.710869Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=765b8305-6471-4e3e-913f-b779ad1dbd4c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3b875d4e-db5b-4b39-9793-0081592de85f] worker_1 | 2022-09-06T16:00:28.724600Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3b875d4e-db5b-4b39-9793-0081592de85f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9e6c9f46-d3e4-46f8-ab3c-1a4005799a5d] worker_1 | 2022-09-06T16:00:29.739222Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9e6c9f46-d3e4-46f8-ab3c-1a4005799a5d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[28f82866-a212-4585-93c4-34f615361b7a] worker_1 | 2022-09-06T16:00:30.752903Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=28f82866-a212-4585-93c4-34f615361b7a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7d9b18c9-da01-45dd-9b2b-71428eb15711] worker_1 | 2022-09-06T16:00:31.765134Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7d9b18c9-da01-45dd-9b2b-71428eb15711 worker_1 | Received task: posthog.celery.redis_heartbeat[4e898830-2b0b-4052-8e19-9e40d383ebaa] worker_1 | 2022-09-06T16:00:32.016417Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4e898830-2b0b-4052-8e19-9e40d383ebaa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aa6f6390-5a97-4c11-8eea-0529a8627902] worker_1 | 2022-09-06T16:00:32.775914Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aa6f6390-5a97-4c11-8eea-0529a8627902 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[18853ea9-c772-4bae-98a0-6be70b922a20] worker_1 | 2022-09-06T16:00:33.791505Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=18853ea9-c772-4bae-98a0-6be70b922a20 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0a056e6f-f10a-4179-a5ac-c92a7a6f67aa] worker_1 | 2022-09-06T16:00:34.800385Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0a056e6f-f10a-4179-a5ac-c92a7a6f67aa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[acfcefcc-a369-42b3-b2f5-1df2d07a3c59] worker_1 | 2022-09-06T16:00:35.817628Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=acfcefcc-a369-42b3-b2f5-1df2d07a3c59 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ffbb352d-f1a4-4bcf-8972-bae3e27ea20d] worker_1 | 2022-09-06T16:00:36.831319Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ffbb352d-f1a4-4bcf-8972-bae3e27ea20d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a35b0790-ef14-4864-a1d3-0d38a0b1eed6] worker_1 | 2022-09-06T16:00:37.847101Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a35b0790-ef14-4864-a1d3-0d38a0b1eed6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[16634c35-6078-4fbe-97bf-6563f0b2cc26] worker_1 | 2022-09-06T16:00:38.861655Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=16634c35-6078-4fbe-97bf-6563f0b2cc26 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3d773bf4-9245-4073-b5d3-5eaa0a691728] worker_1 | 2022-09-06T16:00:39.881054Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3d773bf4-9245-4073-b5d3-5eaa0a691728 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a768fae3-8e19-4a3f-b20b-46908f5f7cc2] worker_1 | 2022-09-06T16:00:40.891504Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a768fae3-8e19-4a3f-b20b-46908f5f7cc2 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[e8405786-3aa2-4d3c-934d-4c302449c205] worker_1 | Received task: posthog.celery.check_cached_items[b99d4558-d798-4add-953d-be35a327a862] worker_1 | Received task: posthog.celery.redis_celery_queue_depth[984cec8b-b3fd-4a79-a872-39b1c8563853] worker_1 | 2022-09-06T16:00:41.902853Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e8405786-3aa2-4d3c-934d-4c302449c205 worker_1 | 2022-09-06T16:00:41.907262Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=984cec8b-b3fd-4a79-a872-39b1c8563853 worker_1 | 2022-09-06T16:00:42.002788Z [info ] update_cache_queue.seen_ages [posthog.tasks.update_cache] ages=[{'insight_id': 21, 'dashboard_id': 4, 'cache_key': 'cache_2f475ea610216844359d02fb8ad0de91', 'age': 360}, {'insight_id': 23, 'dashboard_id': 4, 'cache_key': 'cache_554716c78686a18b5d1d90f1ada98da7', 'age': 359}, {'insight_id': 42, 'dashboard_id': 8, 'cache_key': 'cache_b25750a83ecfb7331ea0167ea492bfa1', 'age': 359}, {'insight_id': 20, 'dashboard_id': 4, 'cache_key': 'cache_21e1f6b32529220e778855aec568ceee', 'age': 358}, {'insight_id': 22, 'dashboard_id': 4, 'cache_key': 'cache_2b2821c1a13afc53a5c6bc450f47ff16', 'age': 358}, {'insight_id': 43, 'dashboard_id': 8, 'cache_key': 'cache_18016e05130ecf29e71981371e5a92c0', 'age': 270}, {'insight_id': 44, 'dashboard_id': 8, 'cache_key': 'cache_824fa13c54b462e126fdbf4f0f3137e6', 'age': 270}, {'insight_id': 47, 'dashboard_id': 8, 'cache_key': 'cache_7725c3c8d96bbe2d77783219706c37c5', 'age': 270}, {'insight_id': 33, 'dashboard_id': 4, 'cache_key': 'cache_db75dd3804765e4b25f12be043e0cafe', 'age': 269}, {'insight_id': 37, 'dashboard_id': 9, 'cache_key': 'cache_2d3427f975ce03ffb1f2473d2daa89d4', 'age': 268}] task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.redis_heartbeat[aaee0079-f93e-4f3e-8cca-adaa91e239ec] worker_1 | 2022-09-06T16:00:42.016960Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aaee0079-f93e-4f3e-8cca-adaa91e239ec worker_1 | 2022-09-06T16:00:42.048558Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=38678fb4-d551-482e-ba00-2e17d91168f3 child_task_name=posthog.celery.update_cache_item_task task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.update_cache_item_task[38678fb4-d551-482e-ba00-2e17d91168f3] worker_1 | 2022-09-06T16:00:42.055881Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=c6d9af3c-10d5-4ae0-913d-cadc07d685e0 child_task_name=posthog.celery.update_cache_item_task task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.update_cache_item_task[c6d9af3c-10d5-4ae0-913d-cadc07d685e0] worker_1 | 2022-09-06T16:00:42.065193Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=24fa2a76-bc3c-41a1-83fe-82b1ded5498d child_task_name=posthog.celery.update_cache_item_task task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.update_cache_item_task[24fa2a76-bc3c-41a1-83fe-82b1ded5498d] worker_1 | 2022-09-06T16:00:42.070988Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=18bb4fd4-dcd8-442c-be25-ac24128c48cc child_task_name=posthog.celery.update_cache_item_task task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.update_cache_item_task[18bb4fd4-dcd8-442c-be25-ac24128c48cc] worker_1 | 2022-09-06T16:00:42.079216Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=46046036-192f-4476-bf4c-165729d2d792 child_task_name=posthog.celery.update_cache_item_task task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | Received task: posthog.celery.update_cache_item_task[46046036-192f-4476-bf4c-165729d2d792] worker_1 | 2022-09-06T16:00:42.089848Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b99d4558-d798-4add-953d-be35a327a862 worker_1 | 2022-09-06T16:00:42.717613Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=38678fb4-d551-482e-ba00-2e17d91168f3 worker_1 | 2022-09-06T16:00:42.831272Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=24fa2a76-bc3c-41a1-83fe-82b1ded5498d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e312d1b1-741f-42d3-babf-7f486fc20fef] worker_1 | 2022-09-06T16:00:43.531171Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_554716c78686a18b5d1d90f1ada98da7 dashboard_id=4 has_results=True insight_id=23 parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=c6d9af3c-10d5-4ae0-913d-cadc07d685e0 worker_1 | 2022-09-06T16:00:43.538715Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=c6d9af3c-10d5-4ae0-913d-cadc07d685e0 worker_1 | 2022-09-06T16:00:43.769459Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=18bb4fd4-dcd8-442c-be25-ac24128c48cc worker_1 | 2022-09-06T16:00:43.774643Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e312d1b1-741f-42d3-babf-7f486fc20fef worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7a38abed-7431-448f-9aa4-15c8df862f51] worker_1 | 2022-09-06T16:00:43.921334Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7a38abed-7431-448f-9aa4-15c8df862f51 worker_1 | 2022-09-06T16:00:44.852750Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_2b2821c1a13afc53a5c6bc450f47ff16 dashboard_id=4 has_results=True insight_id=22 parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=46046036-192f-4476-bf4c-165729d2d792 worker_1 | 2022-09-06T16:00:44.857240Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=b99d4558-d798-4add-953d-be35a327a862 task_id=46046036-192f-4476-bf4c-165729d2d792 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0ecf69f6-b3e2-45b9-afe7-bb52d365cfe0] worker_1 | 2022-09-06T16:00:44.934332Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0ecf69f6-b3e2-45b9-afe7-bb52d365cfe0 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3ca12c99-f65e-484f-a897-54eccb64c389] worker_1 | 2022-09-06T16:00:45.949780Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3ca12c99-f65e-484f-a897-54eccb64c389 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3e139675-d55a-4ea5-8f38-21a9432fccac] worker_1 | 2022-09-06T16:00:46.962545Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3e139675-d55a-4ea5-8f38-21a9432fccac worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4d015cab-d9d8-411b-a40e-fa5bbea29f06] worker_1 | 2022-09-06T16:00:47.974834Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4d015cab-d9d8-411b-a40e-fa5bbea29f06 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fcd8dc82-f785-4c19-b0f7-0ea31c2fda4f] worker_1 | 2022-09-06T16:00:48.987595Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fcd8dc82-f785-4c19-b0f7-0ea31c2fda4f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8d9706aa-05bc-4e91-8176-570443fa2796] worker_1 | 2022-09-06T16:00:50.009589Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8d9706aa-05bc-4e91-8176-570443fa2796 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[78bccc3f-fac9-4c6f-b8ae-a426708477bf] worker_1 | 2022-09-06T16:00:51.034149Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=78bccc3f-fac9-4c6f-b8ae-a426708477bf worker_1 | Received task: posthog.celery.redis_heartbeat[f27db49f-5e76-45b8-b2ad-b93f2c743c38] worker_1 | 2022-09-06T16:00:52.030573Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f27db49f-5e76-45b8-b2ad-b93f2c743c38 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3e8f9a42-64bd-41d5-a04b-98d8050ac994] worker_1 | 2022-09-06T16:00:52.049990Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3e8f9a42-64bd-41d5-a04b-98d8050ac994 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9552a6bf-59c4-4b40-8baf-e5cbd4c39c39] worker_1 | 2022-09-06T16:00:53.056931Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9552a6bf-59c4-4b40-8baf-e5cbd4c39c39 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[96966f12-9b2b-4261-90f1-cb205685f887] worker_1 | 2022-09-06T16:00:54.070483Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=96966f12-9b2b-4261-90f1-cb205685f887 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ce227f8c-dfae-422d-aa58-40eca95f0b0a] worker_1 | 2022-09-06T16:00:55.081570Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ce227f8c-dfae-422d-aa58-40eca95f0b0a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[ff68bffc-2542-4bbd-a30b-6c1dbcbae027] worker_1 | 2022-09-06T16:00:56.096822Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=ff68bffc-2542-4bbd-a30b-6c1dbcbae027 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[978b9d43-6dbd-42db-baac-483d3a4ae7d3] worker_1 | 2022-09-06T16:00:57.108999Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=978b9d43-6dbd-42db-baac-483d3a4ae7d3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7987db95-a6ed-4a26-95e8-92f321fd0322] worker_1 | 2022-09-06T16:00:58.118464Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7987db95-a6ed-4a26-95e8-92f321fd0322 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[38f5fa1f-7dda-41f9-9c14-3ced25c26ea3] worker_1 | 2022-09-06T16:00:59.132517Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=38f5fa1f-7dda-41f9-9c14-3ced25c26ea3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e6031fbc-8e9f-43ed-aba3-415e74de3cde] worker_1 | 2022-09-06T16:01:00.147016Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e6031fbc-8e9f-43ed-aba3-415e74de3cde worker_1 | Received task: posthog.celery.redis_celery_queue_depth[72f669b6-70c9-439e-813e-64df69840099] worker_1 | 2022-09-06T16:01:01.156323Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=72f669b6-70c9-439e-813e-64df69840099 worker_1 | Received task: posthog.celery.graphile_queue_size[10b60f1d-a30b-4229-8837-ffdd1b112c8a] worker_1 | Received task: posthog.celery.pg_table_cache_hit_rate[af291331-92ec-4cff-87d8-40015b9a99a4] worker_1 | 2022-09-06T16:01:01.679267Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=10b60f1d-a30b-4229-8837-ffdd1b112c8a worker_1 | 2022-09-06T16:01:01.697432Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=af291331-92ec-4cff-87d8-40015b9a99a4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b4c5b194-2cbb-4ffa-bf76-a514da52366f] worker_1 | Received task: posthog.celery.redis_heartbeat[2a5e367e-fa64-4aa9-a9bb-0a44f4886a5e] worker_1 | 2022-09-06T16:01:02.175729Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b4c5b194-2cbb-4ffa-bf76-a514da52366f worker_1 | 2022-09-06T16:01:02.175862Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2a5e367e-fa64-4aa9-a9bb-0a44f4886a5e worker_1 | Received task: posthog.celery.clickhouse_row_count[bbe82bff-adf6-4a60-af95-f01f58c9e88f] worker_1 | 2022-09-06T16:01:02.710407Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bbe82bff-adf6-4a60-af95-f01f58c9e88f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6c78c4f7-55e1-4973-81c8-474711d48df8] worker_1 | 2022-09-06T16:01:03.177524Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6c78c4f7-55e1-4973-81c8-474711d48df8 worker_1 | Received task: posthog.celery.clickhouse_lag[1bd51bed-011a-4ad3-aea0-490a050fdc9b] worker_1 | 2022-09-06T16:01:03.723532Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1bd51bed-011a-4ad3-aea0-490a050fdc9b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a116c23d-d3c5-48da-96de-2373e2889c6f] worker_1 | 2022-09-06T16:01:04.185773Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a116c23d-d3c5-48da-96de-2373e2889c6f worker_1 | Received task: posthog.celery.clickhouse_mutation_count[43bd4f3d-ad5d-4a61-834b-6b63eb573b60] worker_1 | 2022-09-06T16:01:04.646830Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=43bd4f3d-ad5d-4a61-834b-6b63eb573b60 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c27ceadb-aa46-4c2c-a539-33b13c3e1373] worker_1 | 2022-09-06T16:01:05.193486Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c27ceadb-aa46-4c2c-a539-33b13c3e1373 worker_1 | Received task: posthog.celery.clickhouse_part_count[a25117b1-43d6-42f7-9347-1e3f5623f09a] worker_1 | 2022-09-06T16:01:05.651138Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a25117b1-43d6-42f7-9347-1e3f5623f09a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7bb224b6-dd41-4963-a06d-4a8ff324d3ff] worker_1 | 2022-09-06T16:01:06.202536Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7bb224b6-dd41-4963-a06d-4a8ff324d3ff worker_1 | Received task: posthog.celery.calculate_cohort[a75ebdfa-081f-466c-8607-0b91c57814ca] worker_1 | 2022-09-06T16:01:06.790592Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 child_task_name=posthog.tasks.calculate_cohort.calculate_cohort_ch task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | Received task: posthog.tasks.calculate_cohort.calculate_cohort_ch[c8afe34f-52e0-44bb-9c34-e2ffb740d446] worker_1 | 2022-09-06T16:01:06.800055Z [info ] cohort_calculation_started [posthog.models.cohort.cohort] current_version=975 id=4 new_version=976 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 worker_1 | 2022-09-06T16:01:06.826012Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=bb682d03-1a31-4c5b-8249-d646cdced867 child_task_name=posthog.tasks.calculate_cohort.calculate_cohort_ch task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | Received task: posthog.tasks.calculate_cohort.calculate_cohort_ch[bb682d03-1a31-4c5b-8249-d646cdced867] worker_1 | 2022-09-06T16:01:06.832205Z [info ] Recalculating cohortpeople starting [posthog.models.cohort.util] cohort_id=4 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size_before=261 task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 team_id=1 worker_1 | 2022-09-06T16:01:06.849101Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 child_task_name=posthog.tasks.calculate_cohort.calculate_cohort_ch task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | Received task: posthog.tasks.calculate_cohort.calculate_cohort_ch[fd44cfe1-1262-424c-9dae-3572e29039d8] worker_1 | Received task: posthog.tasks.calculate_cohort.calculate_cohort_ch[3420fe1d-eaba-400b-86ff-d4fc797f7947] worker_1 | 2022-09-06T16:01:06.883340Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=3420fe1d-eaba-400b-86ff-d4fc797f7947 child_task_name=posthog.tasks.calculate_cohort.calculate_cohort_ch task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | Received task: posthog.tasks.calculate_cohort.calculate_cohort_ch[3bf05fbf-e987-442b-a0fc-d3c0900ea140] worker_1 | 2022-09-06T16:01:06.909321Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 child_task_name=posthog.tasks.calculate_cohort.calculate_cohort_ch task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | 2022-09-06T16:01:06.911275Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a75ebdfa-081f-466c-8607-0b91c57814ca worker_1 | 2022-09-06T16:01:06.991843Z [info ] Recalculating cohortpeople done [posthog.models.cohort.util] cohort_id=4 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size=261 size_before=261 task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 team_id=1 worker_1 | 2022-09-06T16:01:07.006239Z [info ] cohort_calculation_completed [posthog.models.cohort.cohort] duration=0.20508370001334697 id=4 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 version=976 worker_1 | 2022-09-06T16:01:07.007742Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=c8afe34f-52e0-44bb-9c34-e2ffb740d446 worker_1 | 2022-09-06T16:01:07.012777Z [info ] cohort_calculation_started [posthog.models.cohort.cohort] current_version=971 id=6 new_version=972 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 worker_1 | 2022-09-06T16:01:07.033725Z [info ] Recalculating cohortpeople starting [posthog.models.cohort.util] cohort_id=6 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size_before=1681 task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 team_id=1 worker_1 | 2022-09-06T16:01:07.092565Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=bb682d03-1a31-4c5b-8249-d646cdced867 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[aef72770-b574-4219-b5b2-956b0b959ec9] worker_1 | 2022-09-06T16:01:07.201408Z [info ] Recalculating cohortpeople done [posthog.models.cohort.util] cohort_id=6 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size=1681 size_before=1681 task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 team_id=1 worker_1 | 2022-09-06T16:01:07.212534Z [info ] cohort_calculation_completed [posthog.models.cohort.cohort] duration=0.19921358898864128 id=6 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 version=972 worker_1 | 2022-09-06T16:01:07.213053Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=fd44cfe1-1262-424c-9dae-3572e29039d8 worker_1 | 2022-09-06T16:01:07.216510Z [info ] cohort_calculation_started [posthog.models.cohort.cohort] current_version=550 id=8 new_version=551 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 worker_1 | 2022-09-06T16:01:07.241770Z [info ] Recalculating cohortpeople starting [posthog.models.cohort.util] cohort_id=8 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size_before=17 task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 team_id=1 worker_1 | 2022-09-06T16:01:07.263949Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=3420fe1d-eaba-400b-86ff-d4fc797f7947 worker_1 | 2022-09-06T16:01:07.268193Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=aef72770-b574-4219-b5b2-956b0b959ec9 worker_1 | 2022-09-06T16:01:07.345039Z [info ] Recalculating cohortpeople done [posthog.models.cohort.util] cohort_id=8 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca size=17 size_before=17 task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 team_id=1 worker_1 | 2022-09-06T16:01:07.362979Z [info ] cohort_calculation_completed [posthog.models.cohort.cohort] duration=0.1460306259978097 id=8 parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 version=551 worker_1 | 2022-09-06T16:01:07.365396Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=a75ebdfa-081f-466c-8607-0b91c57814ca task_id=3bf05fbf-e987-442b-a0fc-d3c0900ea140 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5b50880d-b579-4f6c-90fb-d6ed44518270] worker_1 | 2022-09-06T16:01:08.207337Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5b50880d-b579-4f6c-90fb-d6ed44518270 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[047b04d2-8716-4b42-9ed3-50fbe1c8e914] worker_1 | 2022-09-06T16:01:09.213270Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=047b04d2-8716-4b42-9ed3-50fbe1c8e914 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[67d4eee4-c228-47a6-a3a2-e2c898f7996a] worker_1 | 2022-09-06T16:01:10.230222Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=67d4eee4-c228-47a6-a3a2-e2c898f7996a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1ff3f05d-3f87-449b-b1a3-4fe079a3fc29] worker_1 | 2022-09-06T16:01:11.243541Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1ff3f05d-3f87-449b-b1a3-4fe079a3fc29 worker_1 | Received task: posthog.celery.redis_heartbeat[3caf059e-ce45-4e0a-95f2-39788964f61d] worker_1 | 2022-09-06T16:01:12.175176Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3caf059e-ce45-4e0a-95f2-39788964f61d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[676af29b-17f0-4d77-94d9-a45ee4dfab2b] worker_1 | 2022-09-06T16:01:12.248456Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=676af29b-17f0-4d77-94d9-a45ee4dfab2b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[33484ebe-7677-4358-b4a3-de15bde40c81] worker_1 | 2022-09-06T16:01:13.261655Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=33484ebe-7677-4358-b4a3-de15bde40c81 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0508c413-f47e-4ddb-91aa-2142f45e73ee] worker_1 | 2022-09-06T16:01:14.276414Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0508c413-f47e-4ddb-91aa-2142f45e73ee worker_1 | Received task: posthog.celery.redis_celery_queue_depth[af414b99-3d32-41c8-961a-66d1e6508f8a] worker_1 | 2022-09-06T16:01:15.287923Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=af414b99-3d32-41c8-961a-66d1e6508f8a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0c75b99f-42b2-44be-a667-c37bc9f5cbc6] worker_1 | 2022-09-06T16:01:16.302611Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0c75b99f-42b2-44be-a667-c37bc9f5cbc6 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c6322aa8-cb73-4c21-b722-ef8a5bcabb18] worker_1 | 2022-09-06T16:01:17.304983Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c6322aa8-cb73-4c21-b722-ef8a5bcabb18 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b65eeb4d-e9f6-42d2-a7ac-63b7703d74b7] worker_1 | 2022-09-06T16:01:18.316290Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b65eeb4d-e9f6-42d2-a7ac-63b7703d74b7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2e1b34d7-de7a-4926-a2ea-5aeae0c65f81] worker_1 | 2022-09-06T16:01:19.331472Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2e1b34d7-de7a-4926-a2ea-5aeae0c65f81 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e6c2ad30-68bf-448d-9448-a631f7a76449] worker_1 | 2022-09-06T16:01:20.363126Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e6c2ad30-68bf-448d-9448-a631f7a76449 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[613dfe9d-99a5-4d70-a251-d0eba0c9a6fb] worker_1 | 2022-09-06T16:01:21.374163Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=613dfe9d-99a5-4d70-a251-d0eba0c9a6fb worker_1 | Received task: posthog.celery.redis_heartbeat[238e6846-0877-4fbf-8abe-11cd63035d7f] worker_1 | 2022-09-06T16:01:22.190181Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=238e6846-0877-4fbf-8abe-11cd63035d7f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c5afa96b-cbe5-4b03-9a87-830a21accdff] worker_1 | 2022-09-06T16:01:22.379892Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c5afa96b-cbe5-4b03-9a87-830a21accdff worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6f6ad711-c34a-4567-ba92-e4687c92fa94] worker_1 | 2022-09-06T16:01:23.391988Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6f6ad711-c34a-4567-ba92-e4687c92fa94 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6d7aa085-73dd-4f51-924a-6ed6124b3ce4] worker_1 | 2022-09-06T16:01:24.412169Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6d7aa085-73dd-4f51-924a-6ed6124b3ce4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6a34eec1-56b4-4dd7-ad20-c2b1aebb1e83] worker_1 | 2022-09-06T16:01:25.419343Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6a34eec1-56b4-4dd7-ad20-c2b1aebb1e83 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[53b6542a-15df-44d8-82bf-eaef99c942b8] worker_1 | 2022-09-06T16:01:26.430033Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=53b6542a-15df-44d8-82bf-eaef99c942b8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0ce590d4-ec7c-4ced-b32f-e2452546efe4] worker_1 | 2022-09-06T16:01:27.443925Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0ce590d4-ec7c-4ced-b32f-e2452546efe4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f3e15b7c-4799-41b7-a158-8b1d89635dd0] worker_1 | 2022-09-06T16:01:28.452767Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f3e15b7c-4799-41b7-a158-8b1d89635dd0 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7f6ba5f7-0566-4bfe-8086-1aae6a29c131] worker_1 | 2022-09-06T16:01:29.468950Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7f6ba5f7-0566-4bfe-8086-1aae6a29c131 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a36e38fe-1109-4ebf-843b-6ceb002901ea] worker_1 | 2022-09-06T16:01:30.482889Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a36e38fe-1109-4ebf-843b-6ceb002901ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e97bcd61-2ccf-4ad3-892e-256f7a88ec87] worker_1 | 2022-09-06T16:01:31.494073Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e97bcd61-2ccf-4ad3-892e-256f7a88ec87 worker_1 | Received task: posthog.celery.redis_heartbeat[25dbc513-befa-4c56-a65c-4ba02adb3edc] worker_1 | 2022-09-06T16:01:32.201928Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=25dbc513-befa-4c56-a65c-4ba02adb3edc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3d9f6ecf-5ba1-46ba-9165-adb3b315ce92] worker_1 | 2022-09-06T16:01:32.504283Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3d9f6ecf-5ba1-46ba-9165-adb3b315ce92 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[469c749a-607f-49e0-9104-fd4133401ac3] worker_1 | 2022-09-06T16:01:33.518721Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=469c749a-607f-49e0-9104-fd4133401ac3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[732c76a5-3852-41f3-8a8e-c52be6ad7699] worker_1 | 2022-09-06T16:01:34.535312Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=732c76a5-3852-41f3-8a8e-c52be6ad7699 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[957fa8be-6259-49fd-9e94-c6dcb0e5d90c] worker_1 | 2022-09-06T16:01:35.546149Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=957fa8be-6259-49fd-9e94-c6dcb0e5d90c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[58221b2d-a461-485c-9679-001887d35c3a] worker_1 | 2022-09-06T16:01:36.564383Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=58221b2d-a461-485c-9679-001887d35c3a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5c3a339f-585f-447f-90d2-c520a7fe0ddd] worker_1 | 2022-09-06T16:01:37.575017Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5c3a339f-585f-447f-90d2-c520a7fe0ddd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b31a0171-8eaf-46ea-b530-48e6511b0557] worker_1 | 2022-09-06T16:01:38.585967Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b31a0171-8eaf-46ea-b530-48e6511b0557 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[fc5f6c8f-bd65-45de-96cd-2eba08b3817e] worker_1 | 2022-09-06T16:01:39.600439Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fc5f6c8f-bd65-45de-96cd-2eba08b3817e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a1206c39-4c12-40fd-ae9d-4ac75469e85c] worker_1 | 2022-09-06T16:01:40.612787Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a1206c39-4c12-40fd-ae9d-4ac75469e85c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0f669fe5-ce9a-4c4f-964f-ff2979b2f8d6] worker_1 | 2022-09-06T16:01:41.626307Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0f669fe5-ce9a-4c4f-964f-ff2979b2f8d6 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[a52f5ba2-4622-4d94-a8a2-a41e254cc48b] worker_1 | 2022-09-06T16:01:41.904926Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a52f5ba2-4622-4d94-a8a2-a41e254cc48b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[56cdf2ee-eceb-4827-84d7-6087c7360d3c] worker_1 | 2022-09-06T16:01:42.636890Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=56cdf2ee-eceb-4827-84d7-6087c7360d3c worker_1 | Received task: posthog.celery.redis_heartbeat[bae0d510-d266-4813-a2f9-23cb6f93bbbe] worker_1 | 2022-09-06T16:01:42.642164Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bae0d510-d266-4813-a2f9-23cb6f93bbbe worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a8b53d47-9aab-4b27-8fb0-54081bd69f46] worker_1 | 2022-09-06T16:01:43.652662Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a8b53d47-9aab-4b27-8fb0-54081bd69f46 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6c3c9b88-3fc8-491b-ac40-cb48b87df991] worker_1 | 2022-09-06T16:01:44.671494Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6c3c9b88-3fc8-491b-ac40-cb48b87df991 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[9d2e43e5-57c6-4eda-8611-ab6040d4bbb9] worker_1 | 2022-09-06T16:01:45.684284Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=9d2e43e5-57c6-4eda-8611-ab6040d4bbb9 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bda7ba1a-08ce-4d07-937e-2d91d4bb621e] worker_1 | 2022-09-06T16:01:46.694524Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bda7ba1a-08ce-4d07-937e-2d91d4bb621e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[25830480-500e-4f95-85ae-e2247c424bbd] worker_1 | 2022-09-06T16:01:47.704378Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=25830480-500e-4f95-85ae-e2247c424bbd worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bf6dad10-41f8-42b7-bca6-c7049d1e41b8] worker_1 | 2022-09-06T16:01:48.712937Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bf6dad10-41f8-42b7-bca6-c7049d1e41b8 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[96952dff-a789-4226-a957-a00564fd49af] worker_1 | 2022-09-06T16:01:49.725698Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=96952dff-a789-4226-a957-a00564fd49af worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cab18803-7dc6-4076-a2f3-6540518a749a] worker_1 | 2022-09-06T16:01:50.736728Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cab18803-7dc6-4076-a2f3-6540518a749a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[e286e001-ffb4-429e-9a2e-a0917a8dbb2e] worker_1 | 2022-09-06T16:01:51.749077Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=e286e001-ffb4-429e-9a2e-a0917a8dbb2e worker_1 | Received task: posthog.celery.redis_heartbeat[4a64d65a-e7ae-4a87-bd5e-df185391418a] worker_1 | 2022-09-06T16:01:52.649467Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4a64d65a-e7ae-4a87-bd5e-df185391418a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d20f2455-32e3-4983-853f-eb3b15173295] worker_1 | 2022-09-06T16:01:52.749325Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d20f2455-32e3-4983-853f-eb3b15173295 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[208cbd15-aa7d-481f-aef8-21d525a260f5] worker_1 | 2022-09-06T16:01:53.759687Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=208cbd15-aa7d-481f-aef8-21d525a260f5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[77e008cd-d2bd-4bc3-9e19-1dd8fc665ad3] worker_1 | 2022-09-06T16:01:54.777620Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=77e008cd-d2bd-4bc3-9e19-1dd8fc665ad3 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cdcdff1e-96d9-4083-bfae-944782f71ea4] worker_1 | 2022-09-06T16:01:55.789053Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cdcdff1e-96d9-4083-bfae-944782f71ea4 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[b5e67536-f6be-4dab-9cef-0e519f564e05] worker_1 | 2022-09-06T16:01:56.804987Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=b5e67536-f6be-4dab-9cef-0e519f564e05 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bf5021e1-e9f4-4022-9abd-9cd172a8b85b] worker_1 | 2022-09-06T16:01:57.816869Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bf5021e1-e9f4-4022-9abd-9cd172a8b85b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[05186a2a-887e-49bb-9425-8d9ed366c984] worker_1 | 2022-09-06T16:01:58.824623Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=05186a2a-887e-49bb-9425-8d9ed366c984 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a29ab35b-8a56-4ec8-b4d9-ad19dfcb420b] worker_1 | 2022-09-06T16:01:59.842170Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a29ab35b-8a56-4ec8-b4d9-ad19dfcb420b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[3342c6a0-2967-4293-bf4b-f30c0fcbc8f8] worker_1 | 2022-09-06T16:02:00.869499Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=3342c6a0-2967-4293-bf4b-f30c0fcbc8f8 redis_1 | 1:M 06 Sep 2022 16:02:01.067 * 100 changes in 300 seconds. Saving... redis_1 | 1:M 06 Sep 2022 16:02:01.068 * Background saving started by pid 18 redis_1 | 18:C 06 Sep 2022 16:02:01.106 * DB saved on disk redis_1 | 18:C 06 Sep 2022 16:02:01.108 * RDB: 0 MB of memory used by copy-on-write redis_1 | 1:M 06 Sep 2022 16:02:01.169 * Background saving terminated with success worker_1 | Received task: posthog.celery.redis_celery_queue_depth[6d5abc06-fc6a-4d24-a3a8-9a20793e9dca] worker_1 | 2022-09-06T16:02:01.877020Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=6d5abc06-fc6a-4d24-a3a8-9a20793e9dca worker_1 | Received task: posthog.celery.redis_heartbeat[fc2e4e91-538c-4b8b-87ef-89ab079c1b1c] worker_1 | 2022-09-06T16:02:02.659174Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=fc2e4e91-538c-4b8b-87ef-89ab079c1b1c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cbb11311-e4cf-41c3-b769-1b8f8993980d] worker_1 | 2022-09-06T16:02:02.887202Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cbb11311-e4cf-41c3-b769-1b8f8993980d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5a7912a8-2e15-4b9c-b5be-9d8f2d00d35b] worker_1 | 2022-09-06T16:02:03.898330Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5a7912a8-2e15-4b9c-b5be-9d8f2d00d35b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[879c8795-8268-400c-8ecd-c285905d5db2] worker_1 | 2022-09-06T16:02:04.910097Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=879c8795-8268-400c-8ecd-c285905d5db2 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[f14ebae1-af8b-41cc-8f61-6e87713ac58a] worker_1 | 2022-09-06T16:02:05.924089Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=f14ebae1-af8b-41cc-8f61-6e87713ac58a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1290f3a2-1b96-463d-91f1-32f17e06491c] worker_1 | 2022-09-06T16:02:06.945476Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1290f3a2-1b96-463d-91f1-32f17e06491c worker_1 | Received task: posthog.celery.redis_celery_queue_depth[da62b28e-25d5-4e79-8a9d-a8968ef347ea] worker_1 | 2022-09-06T16:02:07.947368Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=da62b28e-25d5-4e79-8a9d-a8968ef347ea worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2ce44037-857c-455d-9e7f-b8cc94860325] worker_1 | 2022-09-06T16:02:08.965756Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2ce44037-857c-455d-9e7f-b8cc94860325 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[22870ef2-d0c7-4187-9937-ef90e59f0028] worker_1 | 2022-09-06T16:02:09.975781Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=22870ef2-d0c7-4187-9937-ef90e59f0028 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[64e56cbf-7475-4266-ad72-527812c1fb3a] worker_1 | 2022-09-06T16:02:10.988408Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=64e56cbf-7475-4266-ad72-527812c1fb3a worker_1 | Received task: posthog.celery.check_cached_items[7f6fbbd1-e3f3-47c5-923b-2791430a4598] worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0a1b1f6d-25c9-4834-9ac1-2f8c54c4d013] worker_1 | 2022-09-06T16:02:12.007581Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=80546334-2338-4dcf-9501-24cd66786695 child_task_name=posthog.celery.update_cache_item_task task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | 2022-09-06T16:02:12.011223Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=a0b9971b-01b0-462a-befd-38ce32293565 child_task_name=posthog.celery.update_cache_item_task task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | Received task: posthog.celery.update_cache_item_task[80546334-2338-4dcf-9501-24cd66786695] worker_1 | 2022-09-06T16:02:12.016275Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=a3efec2c-47ac-4e83-ab17-ae5bab878f42 child_task_name=posthog.celery.update_cache_item_task task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | 2022-09-06T16:02:12.015942Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0a1b1f6d-25c9-4834-9ac1-2f8c54c4d013 worker_1 | 2022-09-06T16:02:12.019781Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=bfb9af32-bd02-496d-9ca6-4dc592133a44 child_task_name=posthog.celery.update_cache_item_task task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | Received task: posthog.celery.update_cache_item_task[a0b9971b-01b0-462a-befd-38ce32293565] worker_1 | 2022-09-06T16:02:12.023603Z [info ] task_enqueued [django_structlog.celery.receivers] child_task_id=ebfe0e8f-7d3c-4353-bd44-5f9505cdaf85 child_task_name=posthog.celery.update_cache_item_task task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | Received task: posthog.celery.update_cache_item_task[a3efec2c-47ac-4e83-ab17-ae5bab878f42] worker_1 | 2022-09-06T16:02:12.032305Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 worker_1 | Received task: posthog.celery.update_cache_item_task[bfb9af32-bd02-496d-9ca6-4dc592133a44] worker_1 | Received task: posthog.celery.update_cache_item_task[ebfe0e8f-7d3c-4353-bd44-5f9505cdaf85] worker_1 | 2022-09-06T16:02:12.237690Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_18016e05130ecf29e71981371e5a92c0 dashboard_id=8 has_results=True insight_id=43 parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=80546334-2338-4dcf-9501-24cd66786695 worker_1 | 2022-09-06T16:02:12.241625Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=80546334-2338-4dcf-9501-24cd66786695 worker_1 | 2022-09-06T16:02:12.361396Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=a0b9971b-01b0-462a-befd-38ce32293565 worker_1 | 2022-09-06T16:02:12.585295Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_7725c3c8d96bbe2d77783219706c37c5 dashboard_id=8 has_results=True insight_id=47 parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=a3efec2c-47ac-4e83-ab17-ae5bab878f42 worker_1 | 2022-09-06T16:02:12.588401Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=a3efec2c-47ac-4e83-ab17-ae5bab878f42 worker_1 | Received task: posthog.celery.redis_heartbeat[945dfd03-7216-47f4-9c19-03b64e40fd8c] worker_1 | Received task: posthog.celery.redis_celery_queue_depth[7544ca35-bff4-409e-ad38-729bd4c9984d] worker_1 | 2022-09-06T16:02:13.199406Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=bfb9af32-bd02-496d-9ca6-4dc592133a44 worker_1 | 2022-09-06T16:02:13.202911Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=945dfd03-7216-47f4-9c19-03b64e40fd8c worker_1 | 2022-09-06T16:02:13.205301Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=7544ca35-bff4-409e-ad38-729bd4c9984d worker_1 | 2022-09-06T16:02:13.750074Z [info ] update_insight_cache.processed_item [posthog.tasks.update_cache] cache_key=cache_2d3427f975ce03ffb1f2473d2daa89d4 dashboard_id=9 has_results=True insight_id=37 parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=ebfe0e8f-7d3c-4353-bd44-5f9505cdaf85 worker_1 | 2022-09-06T16:02:13.761248Z [info ] task_succeeded [django_structlog.celery.receivers] parent_task_id=7f6fbbd1-e3f3-47c5-923b-2791430a4598 task_id=ebfe0e8f-7d3c-4353-bd44-5f9505cdaf85 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4e63e423-c191-42cb-846b-ec318f422213] worker_1 | 2022-09-06T16:02:14.029241Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4e63e423-c191-42cb-846b-ec318f422213 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[04436507-e52e-4fce-a129-22cb4fcc4a9a] worker_1 | 2022-09-06T16:02:15.039165Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=04436507-e52e-4fce-a129-22cb4fcc4a9a worker_1 | Received task: posthog.celery.redis_celery_queue_depth[707325f3-a02b-46b3-a746-7014ba6ef4fa] worker_1 | 2022-09-06T16:02:16.053034Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=707325f3-a02b-46b3-a746-7014ba6ef4fa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d6902efa-8626-418b-abfc-c475a3db8580] worker_1 | 2022-09-06T16:02:17.070628Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d6902efa-8626-418b-abfc-c475a3db8580 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[41dde543-2532-4913-acea-d2dfca8f4ed5] worker_1 | 2022-09-06T16:02:18.078393Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=41dde543-2532-4913-acea-d2dfca8f4ed5 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[23617be1-cfda-4bd7-b097-62dcfa967e76] worker_1 | 2022-09-06T16:02:19.093236Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=23617be1-cfda-4bd7-b097-62dcfa967e76 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[c632ac7c-b852-41bc-b79d-9e95737d74b1] worker_1 | 2022-09-06T16:02:20.104998Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=c632ac7c-b852-41bc-b79d-9e95737d74b1 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[11dff79e-a271-4e42-9a04-73d20f8f63aa] worker_1 | 2022-09-06T16:02:21.117764Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=11dff79e-a271-4e42-9a04-73d20f8f63aa worker_1 | Received task: posthog.celery.redis_celery_queue_depth[93f34b51-c64f-43f5-96d1-9d0eb3c15fac] worker_1 | 2022-09-06T16:02:22.129146Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=93f34b51-c64f-43f5-96d1-9d0eb3c15fac worker_1 | Received task: posthog.celery.redis_heartbeat[649ff77e-d55d-4480-83b0-bc9cdac29349] worker_1 | 2022-09-06T16:02:22.681479Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=649ff77e-d55d-4480-83b0-bc9cdac29349 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[4bc0695a-0228-4e17-ae8c-476c069d9c85] worker_1 | 2022-09-06T16:02:23.135677Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=4bc0695a-0228-4e17-ae8c-476c069d9c85 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[0dff38af-47a3-4acf-a663-753b9f074b57] worker_1 | 2022-09-06T16:02:24.141288Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=0dff38af-47a3-4acf-a663-753b9f074b57 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[da72c37c-7395-446e-8999-885ce1f2dc03] worker_1 | 2022-09-06T16:02:25.155421Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=da72c37c-7395-446e-8999-885ce1f2dc03 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[52ab4944-6966-4ec9-8e13-f55a648006d7] worker_1 | 2022-09-06T16:02:26.160881Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=52ab4944-6966-4ec9-8e13-f55a648006d7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d330db08-6c6c-485a-9418-f98b2baa7c7f] worker_1 | 2022-09-06T16:02:27.175122Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d330db08-6c6c-485a-9418-f98b2baa7c7f worker_1 | Received task: posthog.celery.redis_celery_queue_depth[2cde0543-5389-45ce-89f8-a1500f15393e] worker_1 | 2022-09-06T16:02:28.189669Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=2cde0543-5389-45ce-89f8-a1500f15393e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[8e4f469a-b730-4e00-b5d6-0ab77ecb309d] worker_1 | 2022-09-06T16:02:29.202856Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=8e4f469a-b730-4e00-b5d6-0ab77ecb309d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[d02f3655-6b7d-4ee5-9fb4-fe3c19770a02] worker_1 | 2022-09-06T16:02:30.214975Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=d02f3655-6b7d-4ee5-9fb4-fe3c19770a02 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[1ed84087-0fce-4c92-ab39-9300404d7335] worker_1 | 2022-09-06T16:02:31.227217Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=1ed84087-0fce-4c92-ab39-9300404d7335 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[908a5faa-6bb8-47c7-b13d-9a550ab91e67] worker_1 | 2022-09-06T16:02:32.244274Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=908a5faa-6bb8-47c7-b13d-9a550ab91e67 worker_1 | Received task: posthog.celery.redis_heartbeat[83f10f18-f4c3-4964-95fb-5193a47df837] worker_1 | 2022-09-06T16:02:32.690332Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=83f10f18-f4c3-4964-95fb-5193a47df837 ^[[1;2Dworker_1 | Received task: posthog.celery.redis_celery_queue_depth[81ebf80e-f9cc-4cdc-a0f4-0ba7ed076085] worker_1 | 2022-09-06T16:02:33.249088Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=81ebf80e-f9cc-4cdc-a0f4-0ba7ed076085 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[739a5d41-e61b-4278-89ab-6b46d66eabbc] worker_1 | 2022-09-06T16:02:34.257824Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=739a5d41-e61b-4278-89ab-6b46d66eabbc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[04a13416-9d36-4811-bfc5-c0a571f39d06] worker_1 | 2022-09-06T16:02:35.263949Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=04a13416-9d36-4811-bfc5-c0a571f39d06 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[18d713f0-c3fd-4403-83ca-d2ed17047a2e] worker_1 | 2022-09-06T16:02:36.283740Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=18d713f0-c3fd-4403-83ca-d2ed17047a2e worker_1 | Received task: posthog.celery.redis_celery_queue_depth[cccd82df-24e1-4255-a956-c010ce2f0692] worker_1 | 2022-09-06T16:02:37.292119Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cccd82df-24e1-4255-a956-c010ce2f0692 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[bd1fc29f-7c0e-4e57-87f1-bc87f02540cc] worker_1 | 2022-09-06T16:02:38.312911Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=bd1fc29f-7c0e-4e57-87f1-bc87f02540cc worker_1 | Received task: posthog.celery.redis_celery_queue_depth[647f97d6-2117-4557-b3f5-bad67b58c687] worker_1 | 2022-09-06T16:02:39.326336Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=647f97d6-2117-4557-b3f5-bad67b58c687 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[92d669fc-3c70-4846-b28b-61f97edb194d] worker_1 | 2022-09-06T16:02:40.335480Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=92d669fc-3c70-4846-b28b-61f97edb194d worker_1 | Received task: posthog.celery.redis_celery_queue_depth[a87b7ff1-cffc-4aad-a4c0-d207e788e6e1] worker_1 | 2022-09-06T16:02:41.354666Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=a87b7ff1-cffc-4aad-a4c0-d207e788e6e1 worker_1 | Received task: posthog.celery.monitoring_check_clickhouse_schema_drift[cbedb886-9589-4ea8-85b5-fe4484cc9a91] worker_1 | 2022-09-06T16:02:41.897793Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=cbedb886-9589-4ea8-85b5-fe4484cc9a91 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[5be95f30-353c-4a1b-9c77-bf55356861b1] worker_1 | 2022-09-06T16:02:42.352009Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=5be95f30-353c-4a1b-9c77-bf55356861b1 worker_1 | Received task: posthog.celery.redis_heartbeat[14e61997-a571-4576-8daf-7da81c010aa7] worker_1 | 2022-09-06T16:02:42.702063Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=14e61997-a571-4576-8daf-7da81c010aa7 worker_1 | Received task: posthog.celery.redis_celery_queue_depth[70b0ae9b-312a-40a4-bed2-8b08e80f521b] worker_1 | 2022-09-06T16:02:43.363333Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=70b0ae9b-312a-40a4-bed2-8b08e80f521b worker_1 | Received task: posthog.celery.redis_celery_queue_depth[68634e76-6c34-43b0-8c0a-43966d21f01c] worker_1 | 2022-09-06T16:02:44.372581Z [info ] task_succeeded [django_structlog.celery.receivers] task_id=68634e76-6c34-43b0-8c0a-43966d21f01c```
danielthedifficult commented 2 years ago

FWIW: Rebooting the root_web_1 container brings the UI back up.

posthog-bot commented 1 week ago

This issue hasn't seen activity in two years! If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.