pytorch / torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
https://pytorch.org/torchx
Other
304 stars 97 forks source link

privileged flag for local_docker scheduler #897

Open clumsy opened 1 month ago

clumsy commented 1 month ago

Description

It is available for aws_batch already and some docker images require using privileged mode that defaults to false when using local_docker:

docker inspect --format='{{.HostConfig.Privileged}}' <CONTAINER_SHA-1>
false

Motivation/Background

See description

Detailed Proposal

Add a new option and pass it to Docker client for local_docker scheduler.

Alternatives

Patch docker_scheduler.py locally to pass this flag.

Additional context/links

N/A