Closed ion-elgreco closed 3 months ago
There probably isn't much delta-rs
can do here. The Too many open files
error is an operating system error. Most operating systems set a limit as to how many open file descriptors one can have opened at once - and each network connection also counts as an open file descriptor.
On macOS and Debian this can be adjusted using ulimit
command or by editing /etc/sysctl.conf
.
# see your current limit
ulimit -n
# change the limit
ulimit -n 30000
@rob3000 fyi
Discussed in https://github.com/delta-io/delta-rs/discussions/2352