search

UmerHA / quanting-notes

I learn about and explain quantization
25 stars 1 forks source link

Is quantization really that complex? #2

Open rgalljamov opened 4 months ago

rgalljamov commented 4 months ago

Hi UmerHa,

Isn't quantization not just a simple mapping from one range to another?

Thanks in advance Rustam

UmerHA commented 4 months ago

Hi, yes, a general quanting scheme is a mapping from one range (of the higher-bit type) to another range (of the lower-bit type).

Once you have a mapping, applying it is rather easy. The harder part is finding a good mapping (ie quanting scheme) that wastes as little information as possible. Finding a good scheme means choosing regions & representatives.

Quanting schemes specifically designed for AI (not covered yet) are more involved algorithms, and not simply the application of a mappings.