search

Xilinx / Vitis-AI

Vitis AI is Xilinx’s development stack for AI inference on Xilinx hardware platforms, including both edge devices and Alveo cards.
https://www.xilinx.com/ai
Apache License 2.0
1.44k stars 624 forks source link

Vitis AI quantizer #1285

Open ryan880718 opened 1 year ago

ryan880718 commented 1 year ago

I have a question. Can the Vitis AI quantizer be used with formats other than INT8 on the ZCU104? Also, after quantization, is the computation performed using INT8 or is it just stored as INT8? If both options are available, how can we observe the usage of INT4 and INT8 on the ZCU104? Thank you very much!

qianglin-amd commented 11 months ago

Hi @ryan880718 Currently, only INT8 is supported on ZCU104.