search

containers / ai-lab-recipes

Examples for building and running LLM services and applications locally with Podman
Apache License 2.0
111 stars 110 forks source link

Enable NVIDIA services in the bootc image #662

Closed fabiendupont closed 4 months ago

fabiendupont commented 4 months ago

The nvidia-persistenced and nvidia-fabricmanager services should be started on machines with NVIDIA devices. Fabric Manager is only needed on machines with an NVLink switch, so we patch it to start only if /dev/nvswitchctl is present.

fabiendupont commented 4 months ago

/cc @kwozyman

kwozyman commented 4 months ago

Looks okay to me