iTrace-Dev / iTrace-Eclipse

Eclipse plugin to identify textual and interface elements based on iTrace Core gaze data
GNU General Public License v3.0
5 stars 2 forks source link

Token Highlighting Performance #44

Closed dtg3 closed 4 years ago

dtg3 commented 4 years ago

Running from both the last working installer or building from source, the highlighting performance isn't great. I think while staring at a large tightly packed section of text it highlighted one token very briefly and then no others for a fair bit of time. I testing using the Gazepoint and even enlarged the font significantly. The Tobii however seemed to fair better. Can anyone confirm similar behavior?

dtg3 commented 4 years ago

So while tracking with the reticle on I noticed that the Gazepoint tended to drift and overall was less steady. The highlighting improved subtly at 60Hz compared to 150Hz. This could be an issue with the calibration, but the reticle did pass over tokens and only occasionally would they be highlighted.

If others notice similar behavior it might be worth considering hiding the token highlighting from the release. I know it's a cool demo feature, but it might misrepresent how iTrace is performing. Additionally the VS plugin won't have the feature as well, so they would have feature parity. We could then revisit this issue and try to improve the performance for a subsequent release.

dtg3 commented 4 years ago

The gif capturing tool didn't capture the token highlighting overlay. Our built in screen recording tool however did the job very nicely. Since the AVI's are decently large, I've placed them in a folder called Eclipse_Plugin_Issue_44 in the iTrace folder on Google Drive. These show token highlighting performance of the three trackers (Mouse, Tobii, and Gazepoint) on the same line and same file.

All captures were using AbstractAction.java from JHotDraw8, observing content on line 21: public abstract class AbstractAction extends AbstractDisableable implements Action {

Mouse feels a bit sluggish (perhaps because the mouse pointer provides instant positional feedback), the Tobii seems to perform best overall, and GazePoint was kind of abysmal.

This could simply be do to the performance difference between the trackers, but if I only had a GazePoint tracker, I might be inclined to think something is wrong.

If this is a non-issue, then we can close this issue and ship it as is.

dtg3 commented 4 years ago

Based on feedback here and in issue #49 we need to decide if we are shipping this feature or not for the current release.

dtg3 commented 4 years ago

Per Discord discussion, the token highlighted feature will be included in the 0.1.0 release.

The issue will remain open as issue #49 also discusses a redesign of the highlighting mechanisms which may end up being related to this issue.

clptrsn commented 4 years ago

The token highlighter is a lot more responsive now