Adds a quantization level parameter to allow for more gradual introduction of quantization rather than applying it abruptly to the weights and activations for each tensor. Quantization Level = 0 means that there is no quantization happening. Quantization Level = 1 means full quantization. This quantization level is only applied during training to the activations and linears.
Adds a quantization level parameter to allow for more gradual introduction of quantization rather than applying it abruptly to the weights and activations for each tensor. Quantization Level = 0 means that there is no quantization happening. Quantization Level = 1 means full quantization. This quantization level is only applied during training to the activations and linears.