We need some sort of ping when bulletin schemas change. Since we already have CI/CD set up, all we need are some checks and balances on the extraction script that can catch things like these and log it as a report at the end of the daily run:
[ ] total parse error i.e. no data extracted
[ ] number of tables detected != number of tables extracted
Others? @MayankAgarwal
This way we don't have to check manually when schemas need updating.
We need some sort of ping when bulletin schemas change. Since we already have CI/CD set up, all we need are some checks and balances on the extraction script that can catch things like these and log it as a report at the end of the daily run:
Others? @MayankAgarwal
This way we don't have to check manually when schemas need updating.