conda-incubator / conda-store

Data science environments, for collaboration. ✨
https://conda.store
BSD 3-Clause "New" or "Revised" License
137 stars 44 forks source link

[ENH] - Implement log flushing #809

Closed nkaretnikov closed 2 months ago

nkaretnikov commented 2 months ago

Feature description

When an env is being built via build_conda_environment, several actions are running. Each of these actions accumulates output into a StringIO object in ActionContext, which is later written to log storage.

Instead, we need to incrementally write to log storage as soon as the output is available, so that users could get visual indication of progress while the job is running.

See https://github.com/conda-incubator/conda-store/issues/806#issuecomment-2050343922.

Value and/or benefit

Improved UX.

Anything else?