matthias-k / DeepGaze

pytorch implementation of the different DeepGaze models
115 stars 21 forks source link

request for metrics code #1

Closed OneWorld-github closed 2 years ago

OneWorld-github commented 2 years ago

I would very much appreciate it if metrics code was included in this repo, so that the same visualisations that you see from this website

https://deepgaze.bethgelab.org/submissions/ef2eba2b-e171-455a-aa09-b4096d802484

are reproducible from a run.py file in this repo.

Otherwise, it appears that users of this repo would only have a tensor output, that needs post processing to get it to look like the results in the link above.

matthias-k commented 2 years ago

Hi! The code for the visualizations is part of pysaliency. Are you referring to the visualization of the model prediction? Then have a look at pysaliency.plotting.visualize_distribution. The saliency maps for the different metrics are also accessible via pysaliency, check out http://openaccess.thecvf.com/content_ECCV_2018/html/Matthias_Kummerer_Saliency_Benchmarking_Made_ECCV_2018_paper.html and https://github.com/matthias-k/saliency-benchmarking/blob/master/saliency_benchmarking/saliency_map_provider.py#L12 for details. Let me know if you have any further questions.