feat: Use fallocate for file size extension when supported

facebookincubator / velox

A composable and fully extensible C++ execution engine library for data management systems.

https://velox-lib.io/

Apache License 2.0

3.54k stars 1.17k forks source link

feat: Use fallocate for file size extension when supported #11541

Closed zacw7 closed 1 week ago

zacw7 commented 1 week ago

When Copy-on-Write (COW) is disabled on Btrfs, automatic relocation creates snapshots of files, ignoring the noCOW setting. This results in increased disk usage and can lead to "no space left" errors in production.

One possible enhancement we can make is to use fallocate to reserve space immediately after file creation. This helps ensure the allocated space is as continuous as possible.

For environments where "no space left" errors are already happening, attempting to reserve space can result in failures. In that case, fallback to truncate and record it in runtime metrics.

netlify[bot] commented 1 week ago