simonsobs-uk / data-centre

This tracks the issues in the baseline design of the SO:UK Data Centre at Blackett
https://souk-data-centre.readthedocs.io
BSD 3-Clause "New" or "Revised" License
2 stars 1 forks source link

Making xrootdfs available on all worker nodes? #42

Open ickc opened 7 months ago

ickc commented 7 months ago

@rwf14f, what are your thoughts on making xrootdfs available on worker nodes?

Currently, commands like xrdcp and xrdfs are available on worker nodes, but not xrootdfs.

I understand that xrootdfs may not be performant enough to be suitable for heavy data IO, but it can be useful for persistent interactive session for example. I.e. people can start an interactive job, and have the xroodtfs mounted with some of their dotfiles for example. Say when they have some notebooks running, they can quickly save the notebook on disk and have them be persistent in the next interactive session.