search

matthewfeickert / distributed-inference-with-pyhf-and-funcX

Example code for vCHEP 2021 paper "Distributed statistical inference with pyhf enabled through funcX"
MIT License
0 stars 2 forks source link

setup-funcx-on-delta-for-distributed-inference #32

Open ritwik-deshpande opened 1 year ago

ritwik-deshpande commented 1 year ago

We are using apptainer/singularity containers to run custom function on delta HPC GPUs.

Updates:

  1. Using funcx==1.0.10 funcx-endpoint==1.0.10, therefore some modifications in syntax wrt SDK calls for submitting functions.
  2. All delta configs are present in a separate delta folder under funcx. The instructions to operate and setup the endpoint and image is mentioned in the README.md file.
  3. Created a json config file to read the endpoint_id and container_id required as args for the funcX Executor