search

c-scale-community / workflow-coastal-hydrowaq

Porting and deploying the HiSea use case on C-SCALE
Apache License 2.0
3 stars 1 forks source link

@lorincmeszaros @avgils configure download script to download to NFS #25

Closed lorincmeszaros closed 1 year ago

lorincmeszaros commented 2 years ago

This will be tested first on the cloud VM

@nikosT : is it also possible to download data from HPC to NFS ? Previously some limitations were mentioned

nikosT commented 2 years ago

@lorincmeszaros, you can use the scp command. The limitations concern the compute nodes, where they have no internet access for security reasons. However, through login-node, you are able to put/get data, normally. Of course, there are project's storage quotas (but that's another story).

avgils commented 2 years ago

Hi @nikosT, Would it also be fine to use the head node to download data from the internet?

nikosT commented 2 years ago

Hi @nikosT, Would it also be fine to use the head node to download data from the internet?

Hi @lorincmeszaros, this is exactly what you should do; use the login node to download data. Afterward, data would be available to all compute nodes automatically through GPFS.