I know very little about the finer points of AI, but I think it could be really useful to support use of the NPU in new Ryzen and Core Ultra processors, since the silicon is dedicated and does not use as much battery, CPU, or GPU resources. This way, the GPU is kept free and less heat is generated.
Edit: Please note the AMD NPU already supports PyTorch and ONNX.
In a few words, describe your idea
Free up CPU/GPU by using NPUs in newer CPUs
More information
I know very little about the finer points of AI, but I think it could be really useful to support use of the NPU in new Ryzen and Core Ultra processors, since the silicon is dedicated and does not use as much battery, CPU, or GPU resources. This way, the GPU is kept free and less heat is generated.
Edit: Please note the AMD NPU already supports PyTorch and ONNX.