search

The-Academic-Observatory / oaebu-workflows

Telescopes, Workflows and Data Services for the 'Book Analytics Dashboard Project (2022-2025)', building upon the project 'Developing a Pilot Data Trust for Open Access eBook Usage (2020-2022)'
https://documentation.book-analytics.org/
Apache License 2.0
5 stars 0 forks source link

Remove old buckets and datasets with same prefix #107

Closed alexmassen-hane closed 2 years ago

alexmassen-hane commented 2 years ago

Added functions from PR to make a common prefix for the buckets and datasets and will delete them if they are older than 7 days. The prefix is unique to each test and will not delete buckets or datasets created or being used by other tests.

Unit tests will fail until PR is merged.

alexmassen-hane commented 2 years ago

This branch can be closed because we have changed when the check for old datasets/buckets are run. They are now in the ObservatoryEnvironment class and is run every time there is a .create() used.