search

apptainer / singularity

Singularity has been renamed to Apptainer as part of us moving the project to the Linux Foundation. This repo has been persisted as a snapshot right before the changes.
https://github.com/apptainer/apptainer
Other
2.52k stars 424 forks source link

Emit progress information during SIF creation #3725

Closed mikegray closed 1 year ago

mikegray commented 5 years ago

Version of Singularity:

3.0.3

Expected behavior

Some progress or update information during the creation of the SIF file.

Actual behavior

During "Creating SIF file..." step, the console does not produce any visible output for the user - but does create the resulting file eventually.

Steps to reproduce behavior

I was executing a few “larger” builds through the build service as I am testing a few things and I keep noticing that output freezes (temporarily) during INFO: Creating SIF file.... Is it possible to have some type of useful progress during that step? It appears to take awhile but is dependent on maybe the size of the SIF being created? @ikaneshiro mentioned maybe using the progress provided by mksquashfs.

ikaneshiro commented 5 years ago

@mikegray We are currently not forwarding stdout of mksquashfs, so it is running silently in the background. I think we can forward that output through sylog so that a user can get more or less detail by using normal levels of verbosity e.g. -d,-s, etc

mgroth0 commented 3 years ago

Hi, I'm currently running into an issue where my build is seemingly hanging on "INFO: Creating SIF file..." for hours. Eventually, I have to quit the build, because I assume it froze. Builds previously took less than an hour before I switched from singularity 2 to 3. Having extra output here could be helpful.

kyriakosschwarz commented 3 years ago

I agree, it is very slow, so at least some output would be nice.

carterpeel commented 3 years ago

Hello,

This is a templated response that is being sent out to all open issues. We are working hard on 'rebuilding' the Singularity community, and a major task on the agenda is finding out what issues are still outstanding.

Please consider the following:

  1. Is this issue a duplicate, or has it been fixed/implemented since being added?
  2. Is the issue still relevant to the current state of Singularity's functionality?
  3. Would you like to continue discussing this issue or feature request?

Thanks, Carter

mgroth0 commented 3 years ago
  1. Last I checked, this issue has not been fixed. I do not know if its a duplicate.
  2. It's relevant to improving the experiencing of building containers. More verbose log output helps you optimize builds and identify problems.
  3. @ikaneshiro's proposed solution is to forward makesquashfs output when user uses the -d or -s verbosity switches. I, and I'm sure the rest of the community, would greatly appreciate this!
vmiheer commented 3 years ago

I ran into this issue. And it's really frustrating to know especially on clusters.

pedroalvesbatista commented 3 years ago

@mikegray We're looking into the issue carefully, soon will bring to community and discuss ways to better solve as well address this. Thankyou for keeping the interest in the subject.

urlicht commented 2 years ago

Also have the same problem with "large" builds. It'd be great to get a progress bar or some sort of info on the progress/process. On some builds, it hangs on the INFO: Creating SIF file... for a very long time. Eventually I run out of the time on the cluster job, so I haven't tried waiting longer (e.g. over 3 hrs)

kmuriki commented 1 year ago

Pending issues from the old repo are moved to the new repo (https://github.com/apptainer/apptainer/issues/1391) and cleaned from the old, retired repo