search

nihui / vkpeak

A tool which profiles Vulkan devices to find their peak capacities
MIT License
99 stars 3 forks source link

Add INT8-matrix performance - The current industry standard for measuring AI inference in TOPS #14

Open NikosDi opened 4 months ago

NikosDi commented 4 months ago

Hello.

The definition of AI PC by Microsoft and others, the current industry standard for measuring AI inference in TOPS, is at INT8 precision.

I think it would be useful to add INT8-matrix performance metric to find out the TOPS.

TY