search

shivahanifi / GazeMDETR

Apache License 2.0
0 stars 0 forks source link

Evaluate initial result from combining gaze information #8

Open shivahanifi opened 10 months ago

shivahanifi commented 10 months ago

The initial combination of the gaze information resulted in the following output:

MDETR demo w/o gaze PassTheSmallYellowMustardBottleOnTheLeft
Gaze heatmap before and after downsampling normMap_normal_downsampled
GazeMDETR demo PassTheSmallYellowMustardBottleOnTheLeft_gazeAssisted
shivahanifi commented 10 months ago

Next steps:

  1. Soften the normalization of the attention heatmap by adjusting the values between (0.5, 1) #9
  2. Test accuracy with different inputs for both the MDETR and GazeMDETR with the same caption