search

swook / GazeML

Gaze Estimation using Deep Learning, a Tensorflow-based framework.
MIT License
512 stars 141 forks source link

question about calc_landmarks layer #58

Closed david-wb closed 4 years ago

david-wb commented 4 years ago

https://github.com/swook/GazeML/blob/5466f59be70583e7e8c343bda91c8df539aef13a/src/models/elg.py#L272

Mind explaining the rationale for this function? What is the effect of creating the meshgrids, flattening them and multiplying them by the output of the softmax for each heatmap?

david-wb commented 4 years ago

I just realized this is a 2d soft argmax. I wonder if it would work better to calculate the center of mass or centroid.