search

EBISPOT / goci

GWAS Catalog Ontology and Curation Infrastructure
Apache License 2.0
26 stars 19 forks source link

Second user for harmonisation pipeline #1362

Open ljwh2 opened 2 days ago

ljwh2 commented 2 days ago

Discussion with Open Targets on adding us as user in their group. Need to ensure we can publish harmonised files to our ftp.

jiyue1214 commented 2 days ago

Resource limits: Limits on SLURM are applied per GTL. Reaching the resource limit for a group will block all the group members' jobs from starting till any of the running jobs are completed. For the harmonisation pipeline, we use 1 datamover node per day to move the data to FTP and all others are short node

datamover: 120CPU, 960G per GTL Other CPU partitions: 3000 CPUs, 30TB per GTL

If we harmonize the data using the second user account under the other GTL name, we will have higher quota on computing resources and can harmonize more data.

jiyue1214 commented 2 days ago

Prashant Uniyal from the open target group already created a virtual account ot_gwas under the GTL Ellen McDonagh's account that me, Karatug and David Ochoa can access it.

An account has been created, but we are encountering some issues with the settings, preventing successful access. We are currently awaiting TSC's assistance (ticket created): RITM0019933 (Service Desk) and RITM0019826 (HPC)