search

airockchip / rknn-llm

Other
347 stars 29 forks source link

Need Support For INT4 Quantize #12

Closed fydeos-alex closed 6 months ago

waydong commented 6 months ago

The RK3576 platform already supports w4a16 quantization.

fydeos-alex commented 6 months ago

But the RK3588 platform not 😂