brownhci / WebGazer

WebGazer.js: Scalable Webcam EyeTracking Using User Interactions
https://webgazer.cs.brown.edu
Other
3.53k stars 530 forks source link

Cross Domain Training Data Storage #33

Open Skylion007 opened 8 years ago

Skylion007 commented 8 years ago

Currently, we use HTML5 storage to store the user's training data. We may in the future want to add the ability to store local data cross domain using various tricks such as the this library uses.

surdu commented 8 years ago

Maybe as a browser extension would be easier ?

Skylion007 commented 8 years ago

Interesting idea, adapting this extension with the ability to be used a browser extension could provide a lot of possibilities. For instance, you could create heatmaps about where you are staring on screen. Unfortunately, this is a little outside the current scope of this project at the moment, but we are always open to constructive pull requests.

surdu commented 8 years ago

I'll try to see if I have the time to write the extension (as a separate project) that will gather training data and feed it to the storage to all the pages that use the WebGazer.

Don't know if anything I said makes sense, as I didn't had the time yet to look over the code of this project :)

Skylion007 commented 8 years ago

Alternatively, maybe we somehow get the browser to store the data in the domain that the Javascript originates from and start hosting official copies of the script online on a single domain. I haven't had a chance to look into whether that strategy would work or not.

surdu commented 8 years ago

Yes, but with the extension, you have the advantage of gathering training data all the time, and share it with all the sites that need it.

Skylion007 commented 8 years ago

Yeah, but it has occurred to me that to be accurate over long periods of time we really need #2 to be resolved. Otherwise, head movements even just reorienting the webcam would make training data for long periods of time become unreliable. This could still work for a desktop setting though.

Skylion007 commented 8 years ago

So it's look like we may need revisit our training model entirely to safely incorporate head tracking. Other features like #38 will benefit us much more in the short term.

jeffhuang commented 8 years ago

Agreed. This could also be a privacy issue if the user is storing eye tracking data on their computer for long term.

Skylion007 commented 8 years ago

True, but I don't consider the privacy to be much of an issue in this case. After all, there is far more sensitive information stored in the browser already. Keeping the webcam turned on to gather data, is a completely separate but valid concern.