Describe the bug
The hwdetect script greps for "VGA.*NVIDIA" this may not detect all GPUs. It does not pick up Tesla P40s.
I override this with a persistent compose.yaml, but obviously not optimal.
```
# if the COMPUTE_DEVICE env var is not set, try to detect the hardware
if [ -z "$accel" ]; then
echo "Detecting hardware..."
lspci_out=$(lspci)
if echo "$lspci_out" | grep -q "VGA.*NVIDIA"; then
accel="cuda"
else
accel="cpu"
fi
echo "Detected hardware: $accel"
fi
```
context_chat_backend startup
```
Detecting hardware...
Detected hardware: cpu
```
Describe the bug The hwdetect script greps for "VGA.*NVIDIA" this may not detect all GPUs. It does not pick up Tesla P40s. I override this with a persistent compose.yaml, but obviously not optimal.
To Reproduce Steps to reproduce the behavior:
Expected behavior Correct detection of GPUs
Relevant code
context_chat_backend startup
GPUs per LSPCI
Setup Details (please complete the following information):