conda keeps using more disk space, needs warning about cleanup

[ggventurini]

Hi all,

I have just cleaned up multiple machines with disk-space issues due to the fact that conda's cache had become huge and I think something more proactive should be done on conda's side.

I am filing this issue because I believe it should be stressed more in the documentation that the users (which are vested as system admin!) not only are expected to install the packages they need, but they also are expected to clean up after themselves, running, from time to time, coda clean --tarballs and conda clean --packages, too.

The command conda clean <what> is not currently underlined in the docs as a command that must be used from time to time, while I argue it is.

Alternatively, maybe you could set an option to auto-delete source directories and tarballs that are older than say one year? Or print out a hint message when the disk has no more space left?

thanks

[ccordoba12]

@kerrywatson1, could you take a look at this one? Thanks :-)

[kerrywatson1]

Running out of disk space without any warnings is a serious issue that documentation can't solve until after many people have been stumped by the same problem. I recommend adding a warning when disk space is getting full, ~10%, with a prompt "clean up now? Tarballs will be removed. [yes] [no] -> if no, reply "Run conda clean or manually remove unneeded files to prevent running out of disk space."

Also add an error message at ~2% Out of disk space run conda clean now? [yes] [no] .

Back to @ccarlos.

On Saturday, May 2, 2015, Carlos Cordoba notifications@github.com wrote:

Assigned #324 https://github.com/ContinuumIO/anaconda-issues/issues/324 to @kerrywatson1 https://github.com/kerrywatson1.

— Reply to this email directly or view it on GitHub https://github.com/ContinuumIO/anaconda-issues/issues/324#event-295565747 .

[ccordoba12]

I think what @ggventurini wants is to publicize a bit more the existence of conda clean in our current docs.

That's why I pinged you :-)

[kerrywatson1]

I agree, and the warning and error also need to be added.

On Saturday, May 2, 2015, Carlos Cordoba notifications@github.com wrote:

I think what @ggventurini https://github.com/ggventurini wants is to publicize a bit more the existence of conda clean in our current docs.

That's why I pinged you :-)

— Reply to this email directly or view it on GitHub https://github.com/ContinuumIO/anaconda-issues/issues/324#issuecomment-98407419 .

[ccordoba12]

Yep, I agree on both of your remarks too :-)

El 02/05/15 a las 16:46, Kerry Watson escribió:

I agree, and the warning and error also need to be added.

On Saturday, May 2, 2015, Carlos Cordoba notifications@github.com wrote:

I think what @ggventurini https://github.com/ggventurini wants is to publicize a bit more the existence of conda clean in our current docs.

That's why I pinged you :-)

— Reply to this email directly or view it on GitHub

https://github.com/ContinuumIO/anaconda-issues/issues/324#issuecomment-98407419 .

— Reply to this email directly or view it on GitHub https://github.com/ContinuumIO/anaconda-issues/issues/324#issuecomment-98407485.

[asmeurer]

psutil may be useful here https://github.com/giampaolo/psutil#disks

[wojdyr]

In many scenarios there is little value in keeping unused unpacked packages. Perhaps conda could clean packages automatically when they are unlinked? If not by default than maybe as an option set in config. Doing it manually is a chore for the user.

[michaelaye]

yep, just reclaimed 18 GB of disk space today again.. :o