Open V0XNIHILI opened 4 months ago
@Giuseppe5 do you know more about this?
Yes, apologies for the late reply. Later tomorrow I will publish an example of how to achieve this, but in general it should be possible since zero point and scale have independent shapes that can be individually specified when instantiating a new quantizer.
@Giuseppe5 if you have the time, I would still really love to see how we can achieve this with Brevitas 😁
Apologies for the delay, but it is a bit more complicated than I originally thought.
It is still possible but it requires to play a bit more with dependency injection. I'll try to look into it but not sure when at this point. Apologies.
No problem! Do you have a reference for me on where to start from/where to look?
You need to create a quantizer where:
How would I go about implementing the above feature in Brevitas? Where should I get started and is this even possible in the way Brevitas is currently set up?