huggingface / optimum-quanto

A pytorch quantization backend for optimum
Apache License 2.0
833 stars 62 forks source link

Its not an issue! Quantization Granularity Question #351

Open ClaraLovesFunk opened 2 weeks ago

ClaraLovesFunk commented 2 weeks ago

Dear David,

thanks for already answering my previous questions! Wrapping up my report I tried to find information about the granularit. Which quantization granularity was implemented in static/dynamic quantization?

Cheers and thank youu very much for your help! Clara