OHDSI / Achilles

Automated Characterization of Health Information at Large-scale Longitudinal Evidence Systems (ACHILLES) - descriptive statistics about a OMOP CDM database
https://ohdsi.github.io/Achilles/
130 stars 121 forks source link

add achilles_processing table #682

Open fdefalco opened 2 years ago

fdefalco commented 2 years ago

A potential change in the way we manage achilles processing, this would add a table in which the execution details for each analysis are stored. This would include the analysis_id, execution_duration, count_rows_generated, execution_timestamp, error.

This could be leveraged to ensure only successful analyses are merged into the final table, whereas currently the final merge will fail because an analysis that fails does not create its temp table for the final merge.

alondhe commented 1 year ago

Another benefit will be not having to worry about stratum casts in WebAPI drilldown queries, which are currently failing in Redshift for us (and confirmed by @clairblacketer in your env).