search

containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman
Apache License 2.0
103 stars 106 forks source link

Enable NVIDIA services in the bootc image #662

Closed fabiendupont closed 2 months ago

fabiendupont commented 2 months ago

The nvidia-persistenced and nvidia-fabricmanager services should be started on machines with NVIDIA devices. Fabric Manager is only needed on machines with an NVLink switch, so we patch it to start only if /dev/nvswitchctl is present.

fabiendupont commented 2 months ago

/cc @kwozyman

kwozyman commented 2 months ago

Looks okay to me