astral-sh / uv

An extremely fast Python package and project manager, written in Rust.
https://docs.astral.sh/uv
Apache License 2.0
19.9k stars 586 forks source link

Too many open files when syncing a big project #6508

Closed yoav-orca closed 2 weeks ago

yoav-orca commented 3 weeks ago

When trying to resolve a very big project (413 direct dependencies and 673 indirect dependencies). I can't share the specific requirements. I'm consistently running out of fds:

error: Failed to write to the client cache
  Caused by: Too many open files (os error 24) at path "/Users/yoavalon/.cache/uv/simple-v12/pypi/.tmpPKond8"
charliermarsh commented 3 weeks ago

macOS has a very low open-file limit. Running ulimit -n 16000 should unblock you here.

FCamborda commented 3 weeks ago

if you are running this when building with Docker, there are CLI flags to control the file handle limit during that process.

zanieb commented 2 weeks ago

Unfortunately not much we can do about this — the default is weirdly low.

charliermarsh commented 2 weeks ago

Going to close. The answer is above for future readers, but if it continues to come up we can add to the docs explicitly.