Open sohaib-idalin opened 2 months ago
I see that you mention that top-K sparsification must zero out 1-top_k_percent percent of the model update elements with the lowest absolute values. But in the code, I see that you forgot to use the absolute values of the vector.
Thanks for finding this mistake!
your welcome
I see that you mention that top-K sparsification must zero out 1-top_k_percent percent of the model update elements with the lowest absolute values. But in the code, I see that you forgot to use the absolute values of the vector.