bihealth / sodar-server

SODAR: System for Omics Data Access and Retrieval
https://github.com/bihealth/sodar-server
MIT License
14 stars 3 forks source link

Add landing zone validate/move progress information #2024

Open january3 opened 1 month ago

january3 commented 1 month ago

Problem

Validation and moving of LZs can sometimes take quite a lot of time. It would be good to know, in terms of orders of magnitude, how much more time this is going to take (minutes? hours? days?)

Solution

A progress indicator in the LZ view, optimally with a time estimate should provide a user feedback (e.g. 15/127 files validated in 2 hours, or: 15/127 validated, approximately 2 hours remaining).

mikkonie commented 1 month ago

Moving this into the SODAR server repo, as this software does not concern that part.

mikkonie commented 1 month ago

This is partially discussed in #1919. I agree that there should be a way to see more detailed output regarding the progress of these operations.

Time estimates are a very difficult thing though. In the end these depend on the iRODS backend file system(s) which SODAR has no knowledge of. We would need some way to gauge and store expected performance of the backend. I'm all for ideas on how to do that, not my area of expertise TBH.