ggerganov / llama.cpp

LLM inference in C/C++
MIT License
60.95k stars 8.7k forks source link

llama : NvAPI performance state change support #8116

Open sasha0552 opened 3 days ago

sasha0552 commented 3 days ago

Related: #8084

Reference implementation

TODO: