I appreciate your Log2Quantization methods in FQ-Vit but I have a questions that:
when activations and weights equal to zero, we can not log2(0), and when they are negtive numbers ,we can not opreate it , either. But it seems in the code it did not notice that problem.
I appreciate your Log2Quantization methods in FQ-Vit but I have a questions that: when activations and weights equal to zero, we can not log2(0), and when they are negtive numbers ,we can not opreate it , either. But it seems in the code it did not notice that problem.