search

simonsobs-uk / data-centre

This tracks the issues in the baseline design of the SO:UK Data Centre at Blackett
https://souk-data-centre.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2 stars 1 forks source link

How to modify TOAST in the provided software stack #18

Open ickc opened 9 months ago

ickc commented 9 months ago

Migrated from Slack.

People involved: @earosenberg

Erik Rosenberg 3:53 PM I'm also having a second issue, my sims need a newer version of TOAST than included in your tarball. I have been using 3.0.0a18 (commit 6a03ec95) at NERSC but newer (ie the most recent toast3) would probably be fine. I did try: download your tarball to my laptop; unzip to /tmp; complile TOAST with -DMAKE_INSTALL_PREFIX=/tmp/{pmpm-....} and upload back to Blackett, but it complains "GLIBC_2.29 not found" when I try to run there. More details on how to correctly make the tarball so it's portable (or just an updated tarball for now) would be much great when you get a chance

ickc commented 9 months ago

@earosenberg, it is very likely that when you compiled it yourself, you didn't set the necessary PATHs such as LD_LIBRARY_PATH.

I will think about how to put up instructions in setting up "portable" TOAST like I did. Meanwhile I think it probably would be quicker for me to update the software there. I can probably have it in early next week.

earosenberg commented 9 months ago

Just to update this @ickc: I found that I was able to pip install the verison I needed from the git repo and successfully deploy it on Blackett, so updating the tarball is no longer urgent for me. However more detailed instructions on how to set up portable TOAST would still be useful I think

ickc commented 9 months ago

I should have mentioned that method too. Some background: While toast is released on both conda and PyPI, only that from PyPI has the currently pre-released version of toast 3. Conda only has toast 2. But the SO stack depends on toast 3.

And then the one from PyPI (installable using pip) is inferior. It is probably documented in its documentation. And I forgot what is the deficiency. Probably that doesn't come with libmadam, and possibly it is not MPI capable. We don't need libmadam in SAT analysis.

There's actually a conda recipe Ted is maintaining, available in SO GitHub. Using that would be better than the PyPI package in terms of capability and portability, but is more involved. (Ie it is just a recipe and you need conda-build.) I probably will document it later.

ickc commented 8 months ago

I'll push back documenting this to next release as the "grid storage system" part is more critical and used up my time.

ickc commented 4 months ago

The pip-install method is documented in eedb41a5c5c5c97ac8dc28ed512e68957c6ba9c9