search

hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
630 stars 90 forks source link

Bloom int8 mode prototype #172

Closed CsRic closed 1 year ago