WordPress / openverse

Openverse is a search engine for openly-licensed media. This monorepo includes all application code.
https://openverse.org
MIT License
254 stars 203 forks source link

Staging database restore can run concurrently with staging data refresh #5128

Closed stacimc closed 1 week ago

stacimc commented 3 weeks ago

Description

If the staging database restore runs concurrently with a staging data refresh, it wipes out the DB while it is being acted upon and causes everything to fail (noisily).

Something must not be working in the existing concurrency checks.

Workaround: disable the staging_database_restore DAG while testing data refreshes in staging (hence high priority rather than critical).