Monitoring of the ETL process by Logging - Githubissues

amosproj / amos2024ss08-cloud-native-llm

MIT License

7 stars 1 forks source link

Monitoring of the ETL process by Logging #10

Closed dominic0df closed 4 months ago

dominic0df commented 5 months ago

User story

As a Data Engineer
I want to implement a logging system
So that I am able to identify problems in the dataset creation

Acceptance criteria

[ ] The amount of data loaded is logged (f.e. counter)
[ ] An indicator how far the ETL process has advanced is implemented
[ ] The cause of requests that failed and could not be retried is logged
[ ] The cause of requests that failed and where the retry exceeded is logged

Definition of done (DoD)

Added only after week 5
The same for all features
Here goes the project specific part

DoD general criteria

Feature has been fully implemented
Feature has been merged into the mainline
All acceptance criteria were met
Product owner approved features
All tests are passing
Developers agreed to release

dominic0df commented 4 months ago

actual size 2