[Feature Request] Additional Profiling Statistics

quic / ai-hub-models

The Qualcomm® AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

https://aihub.qualcomm.com

BSD 3-Clause "New" or "Revised" License

338 stars 45 forks source link

[Feature Request] Additional Profiling Statistics #42

Open jasonw247 opened 1 month ago

jasonw247 commented 1 month ago

Is your feature request related to a problem? Please describe. I am currently using profiling jobs to understand resource usage for models. The metrics included in the job are useful, but more granular and longitudinal metrics would be useful.

Describe the solution you'd like Graphs/statistics for:

CPU usage
RAM usage
Accelerator (GPU/NPU) usage

This would be useful to understand the resource requirements/allocation for a given model.

mestrona-3 commented 1 month ago

Hi @jasonw247, thanks for the submission! I'll review this with our team and update here if/when we have an update.