Azure / hpcpack

The repo to track public issues for Microsoft HPC Pack product.
MIT License
29 stars 11 forks source link

Additional Filters #15

Closed webstc2 closed 3 years ago

webstc2 commented 3 years ago

Feature Request Description

The ability to specify a filter that will run directly on each compute node before the job starts running on the node.

Describe Preferred Solution

As above.

Describe Alternatives Considered

This could be included in the job but it would be advantageous to have a standard for all jobs.

Additional Context

In my case, this would be used to create a folder and alter the permissions of the folders and files. The permissions would be altered to ensure security compliance for restrictions on data access to running jobs

phxnsharp commented 3 years ago

Shouldn't you just use a Node Preparation Task in your job submission?

https://docs.microsoft.com/en-us/powershell/high-performance-computing/define-a-node-preparation-task?view=hpc19-ps

You can even define a Job Template that defines a standard Node Preparation Task to automatically add to all jobs created from it.

webstc2 commented 3 years ago

This is meant to be a potentially useful addition not necessarily a requirement at the moment.

Node preparation tasks run with the privileges of the user. If we want to do anything that requires admin rights without this hypothetical filter then it would require making the users admins.

Currently we accomplish everything that we need via the NodePrep task.

YutongSun commented 3 years ago

Node Prep task is the way to go.