search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.77k stars 2.94k forks source link

Int4 support #22850

Open BoarQing opened 1 week ago

BoarQing commented 1 week ago

Description

Motivation and Context