Closed ringsaturn closed 11 months ago
2023-11-24 12:08:53,339 WARNING CliMetLab cache: trying to free 739.2 GiB 2023-11-24 12:08:53,339 WARNING Decaching files oldest than 2023-11-24T12:08:21.254908 (age: 32 seconds) 2023-11-24 12:08:53,352 WARNING CliMetLab cache: could not free 739.2 GiB
For some reason, CliMetLab could not free cache space and is deleting the files as it downloads them. This could happen for various reasons. Perhaps because you don't have enough space on your cache disk? This may help https://climetlab.readthedocs.io/en/latest/guide/caching.html
Adding the versions of the packages and the platform would also help debugging.
2023-11-24 12:08:53,339 WARNING CliMetLab cache: trying to free 739.2 GiB 2023-11-24 12:08:53,339 WARNING Decaching files oldest than 2023-11-24T12:08:21.254908 (age: 32 seconds) 2023-11-24 12:08:53,352 WARNING CliMetLab cache: could not free 739.2 GiB
For some reason, CliMetLab could not free cache space and is deleting the files as it downloads them. This could happen for various reasons. Perhaps because you don't have enough space on your cache disk? This may help https://climetlab.readthedocs.io/en/latest/guide/caching.html
Adding the versions of the packages and the platform would also help debugging.
System info:
NAME="Ubuntu"
VERSION="18.04.6 LTS (Bionic Beaver)"
ID=ubuntu
ID_LIKE=debian
PRETTY_NAME="Ubuntu 18.04.6 LTS"
VERSION_ID="18.04"
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
VERSION_CODENAME=bionic
UBUNTU_CODENAME=bionic
I'm using Python3.11 via MiniConda. For the context, most relevant packages as belows:
climetlab==0.18.6
ai-models==0.2.15
-e git+https://github.com/ecmwf-lab/ai-models-graphcast@023e6537791cb9650e92b85251eb528f0948cc4e#egg=ai_models_graphcast
Or a much detailed freeze output,
The tmp dir was made via a soft link to a folder on a mounted disk:
lrwxrwxrwx 1 ringsaturn ringsaturn 44 Nov 24 11:45 climetlab-ringsaturn -> /mnt/data22/ringsaturn/climetlab-ringsaturn/
which has 32G space. The disk status as belows:
Filesystem Size Used Avail Use% Mounted on
/dev/sdl1 7.3T 6.9T 32G 100% /mnt/data22
I choose to use another disk with more free space and solve this. It’s not project’s bug.
Command:
It appears that code was trying to read a file that jsut deleted:
Then:
The full log is here: https://gist.github.com/ringsaturn/930fdd499b224f0e8778a6fd680808d3#file-errors-log-L558