smart-on-fhir / cumulus-etl

Extract FHIR data, Transform with NLP and DEID tools, and then Load FHIR data into a SQL Database for analysis
https://docs.smarthealthit.org/cumulus/etl
Apache License 2.0
11 stars 2 forks source link

Use a library like `rich` to create prettier progress reports #103

Closed mikix closed 7 months ago

mikix commented 1 year ago

We have a few places we do long-running jobs:

It would be nice if we had more unified output for that. The rich library (used by pip) is a strong contender, but maybe some implementer research will yield something else.

There are two "consumers" of nice output:

Which I only mention because it's worth testing that whatever solution used doesn't generate a million lines of a bouncing hashmark when it doesn't have a real console that can "backspace".

mikix commented 1 year ago

The bulk export code might be a good first step for this feature. It has some interesting existing complexities that we'd want to know how to carry over in rich (or whether they no longer make sense):

mikix commented 7 months ago

This got done a while back - we have generally nice feedback via rich these days. Room for improvement, but I'll close this general issue.