search

Zhen-Dong / HAWQ

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.
MIT License
410 stars 83 forks source link

about the shape of v #11

Open j00378808 opened 3 years ago

j00378808 commented 3 years ago

What's the meaning of For a random vector v (which has the same dimension as gi)？？According to my understanding,v is a vector ，but gi is a matrix???

Zhen-Dong commented 3 years ago

Hi, I think by definition the gradient is a vector and the Hessian is a matrix. Hope this can be helpful for clarification.