The reproducibility of an instance of an assessment in TAF depends on the version of the data i.e. if TAF is dynamically fetching data from a database and the data has changed in the database, then the results of the assessment can also change. To control for this, a snapshot of the data of the assessment instance is stored in TAF. A decision should be made on how reproducible TAF assessments need to be and the TAF manifesto updated to make any limitations more explicit.
Repositories using scripts in boot/initial might be difficult to replicate if the databases, i.e. DATRAS, change.
Do we need a standard snapshot method for these cases?
Summary
The reproducibility of an instance of an assessment in TAF depends on the version of the data i.e. if TAF is dynamically fetching data from a database and the data has changed in the database, then the results of the assessment can also change. To control for this, a snapshot of the data of the assessment instance is stored in TAF. A decision should be made on how reproducible TAF assessments need to be and the TAF manifesto updated to make any limitations more explicit.
Repositories using scripts in boot/initial might be difficult to replicate if the databases, i.e. DATRAS, change.
Do we need a standard snapshot method for these cases?
task list