search

mjuric / conda-lsst

Building Conda packages for the LSST stack
4 stars 8 forks source link

conda build does not allow for installation into large directory structures #63

Closed danielsf closed 8 years ago

danielsf commented 8 years ago

see

https://github.com/DarkEnergyScienceCollaboration/Twinkles/issues/210

Basically: somewhere inside of the conda build, a limited number of characters are allotted for the root directory into which the conda packages are installed. Shared machines at large computing centers a la NERSC run afoul of this limit by forcing everyone's home directory to live at the end of a very long directory tree. This causes the installation of the conda package to fail.

mjuric commented 8 years ago

The particular symptom mentioned in https://github.com/DarkEnergyScienceCollaboration/Twinkles/issues/210 is an upstream issue with Continuum's build of swig, and the fact their binary prefixes are currently limited to 80 characters (see here for the code and here for the docs).

@heather999, could you open an issue at https://github.com/conda/conda-build/issues asking them for a change (you could even change the offending line to, say, 128 instead of 80 characters, and directly open a PR)? It was already discussed here so it may be uncontroversial.

That said, this did make me think about our recipes and the fact we have detect_binary_files_with_prefix set to False. I should probably flip it to True, as we're now shipping much more than just Python code!

heather999 commented 8 years ago

Thanks, @mjuric, with all that background information, I could hardly refuse trying a PR :) https://github.com/conda/conda-build/pull/877

mjuric commented 8 years ago

Closing as this is an upstream issue with conda.