bkardell / bcd-watch

News feeds and helpful reports auto-generated from bcd data
http://bcd-watch.igalia.com
27 stars 3 forks source link

When to run the reports #43

Closed bkardell closed 1 month ago

bkardell commented 3 months ago

There is a tricky balance here and I'm not sure we've got it right just yet.

We get our data from bcd releases - that is, we check automatically for new bcd releases, but bcd's release schedule is a little sporadic. It's frequently twice a week, but I think mainly driven by a small number of (maybe even just Vinyl?) - so if they on holiday or are sick or just behind - it can take longer between updates.

When we did this originally, we thought we should probably make it so that you don't get more than 1 report in a week - it feels easier to miss and the reports will likely be even smaller if they are more than once a week. 'Weekly' seems like a nice cadence - and we get our reports by diffing so the duration between doesn't matter as long as we have a copy of the data at that time. So, we grab an update and check the meta information vs our last update and if it hasn't been > 5 days since the last report, we simply don't generate a new one. That means we generally get a report about once a week. But it also means you don't get a report if there isn't a release - so, for example, as I write this, the last report we have is from August 2, 10 days ago. But the last release we have available was on the 7th - it fell into this gray area where it didn't generate an updated report.

The 'obvious' thing I can think of to do would be to say 'it there is a release and the release data is > 5 days.. OR if it's been N calendar days we force it". However, the date it runs agains will still be shorter number of days (that is, it would generate the one against the 7th's release), and then in all likelihood when the next release happens in the next couple of days it might be in the same situation where it hasn't been long enough since the 7th to generate a report. I'm not sure which is worse or how to best trade-off/resolve

bkardell commented 3 months ago

Both #48 and #49 are solutions to how we might want to improve this. The main differences from a user's standpoint are that users will always get a report on monday with the secondone (and that I've back-filled all of the available releases going back to the 2021 so that I could set the monday/releases archives/going forward straight).

Of course, it's also the difference between a 1 line change or a fairly significant rewrite ... What say you @meyerweb ?

bkardell commented 1 month ago

Hmm, why is this still open? We chose the hard way, but I think it's done now