search

usegalaxy-eu / infrastructure-playbook

Ansible playbook for managing UseGalaxy.eu infrastructure.
MIT License
16 stars 92 forks source link

update config for 24.1 #1225

Closed bgruening closed 2 months ago

sanjaysrikakulam commented 2 months ago

I have added a new commit that:

  1. Adds object store and file source templates and the catalog for the same.
  2. Updates galaxy upgrade diff script to include the compare for these templates.
  3. Enables the file source and object store template variables in the galaxy conf.
  4. Updates sn06 group vars to allow the creation of the new dirs file_source_templates and object_store_templates under galaxy_mutable_config_dir. Also, copies the file source and object store templates along with the catalog files to the respective locations on the server.

I deployed the same in the ESG instance, and the object store and file source options are now available for the users in the user preferences.

sanjaysrikakulam commented 2 months ago

BTW: I created an issue in the upstream related to the object store https://github.com/galaxyproject/galaxy/issues/18500

We either have to wait a bit or proceed with the rollout without the object stores and deploy object stores later.

sanjaysrikakulam commented 2 months ago

Things to set in the galaxy config for the object store:

  1. object_store_cache_path: We need a Universal path for all user object stores (I guess we need to get a dedicated NFS share or create a dedicated user_object_store_cache dir in one of the JWDs. I don't know how big this should be and how well this feature is going to be used by our users).
  2. object_store_cache_size: Set this to the max size of the object_store_cache_path NFS share.

BTW: I have added version: 0 to all the templates part of this PR, so the templates in this PR are the same as the ones in my PR here

ping @bgruening.

bgruening commented 2 months ago

We can disable this feature for the time being.

bgruening commented 2 months ago

A new NFS is ordered and we will use that when we advertise this feature broadly.

bgruening commented 2 months ago

So lets disable this feature then.

sanjaysrikakulam commented 2 months ago

I have now disabled copying the object store and file source template catalogs.

I think the PR is ready for review. Please check.

bgruening commented 2 months ago

Good for me. I'm I allowed to do the update this evening or better tomorrow evening?

sanjaysrikakulam commented 2 months ago

Tomorrow evening is better.

By the way, this patch fixes the object store issue. When we have the new NFS box, we can deploy the user file source and the object store features.

bgruening commented 2 months ago

So any last comments before I deploy it this evening?