RunTogether / opendata

Documentation, Changelog and Issues related to the Run Together RPDE endpoint
0 stars 0 forks source link

Remove old items past a Retention Period #6

Open domfennell opened 4 years ago

domfennell commented 4 years ago

Hi,

We wondered if you would consider implementing a retention period? We at imin think this would be beneficial to you and also the users of your data.

Retention periods are discussed in the OpenActive Developer Docs (here), which suggest setting the state of "old" items (i.e. items with a startDate that is in the past) to "deleted" and then deleting them "at least 7 days from the point in time at which it transitioned to a "deleted" state".

This would help us immensely as we sometimes need to re-ingest your feed and it takes a while to get through it as it includes runs from 2016 onwards. Hopefully the ability to delete old sessions from the database (or move them to an archive) would also help you with cutting costs/increasing performance.

Very best,

Dom