supercluster-covid-data-portal / etl

GNU Affero General Public License v3.0
0 stars 1 forks source link

Add Monitoring to ETL Service #14

Open b-f-chan opened 2 years ago

b-f-chan commented 2 years ago

Enhancement / improvement for future - Add an easier way to monitor success & failure of the ETCL service

Currently a record is logged in the DB of each ETL run and its result, but there is no way to properly monitor in real-time for constant failures or for anyone to access the data without connecting to the ETL DB

Need to brainstorm a design