search

conda-forge / conda-forge-ci-setup-feedstock

A conda-smithy repository for conda-forge-ci-setup.
BSD 3-Clause "New" or "Revised" License
13 stars 53 forks source link

Increase page size for azure windows agents? #155

Closed h-vetinari closed 3 years ago

h-vetinari commented 3 years ago

After often encountering 

OSError: [WinError 1455] The paging file is too small for this operation to complete

in https://github.com/conda-forge/numpy-feedstock/pull/237 & many other pull requests (for numpy), I decided to have a quick look at what's behind that.

Stumbling over this discussion (regarding GH Actions), someone noted:

I’ve investigated this issue and the problem is that Windows decides to create a single page file on the D:\ drive, which has only 14 GB, and by default it allocates only 1/8th of the volume size, or about 1.75 GB. This is a very small page file by modern standards and many applications will fail.

How about adding an option (or step) to the ci-setup that allows setting the page file size? It seems to be possible for GHAs - someone published an action for it (it's MIT licensed so we could even reuse some of that code).

isuruf commented 3 years ago

PRs welcome. I don't think we need an option for this. Doing this unconditionally makes sense.

isuruf commented 3 years ago

Wait, maybe only if CONDA_BLD_PATH is set to C://bld//

h-vetinari commented 3 years ago

Core of such a PR would IMO be copying SetPageFileSize.ps1 and calling it from run_conda_forge_build_setup_win.bat appropriately (i.e. if-cond & params) - would you want that in recipe/ or recipe/conda_forge_ci_setup or elsewhere?

isuruf commented 3 years ago

In recipe is fine.

h-vetinari commented 3 years ago

See #156