Housekeeping - Githubissues

ea7klk / bm-lastheard-node

NodeJS app that gets Lastheard data from the Brandmeister server, ignores all direct calls, inserts the data into a SQLITE database and shows some useful stats

Creative Commons Zero v1.0 Universal

0 stars 0 forks source link

Housekeeping #7

Open kerk1v opened 2 weeks ago

kerk1v commented 2 weeks ago

Remove data older than a certain threshold (15 days?)
Decide how to do it (endpoint, whatever...) and periodicity
Decide what to do with old data (Summarize, archive, DataLake, analyze...)

kerk1v commented 2 weeks ago

Added housekeeping every 10000 inserted records, they now get moved to another table. This also speeds up queries.
Reduced live data to 2 days, as the purpose of the app is more to see "What's on at Brandmeister"
Still haven't decided what to do with old data.