dmirman / gazer

Functions for reading and pre-processing eye tracking data.
43 stars 11 forks source link

Can GazeR analyze eye movement data in virtual reality environments? #28

Open Liujiaxu-Xx opened 1 year ago

Liujiaxu-Xx commented 1 year ago

We built a 3D scene in Unity and then used the HTC VIVE pro eye, a virtual reality headset device, to obtain eye movement data as follows. QQ图片20230405144401 The data includes pupil size, gaze direction, and gaze starting position for both eyes, but the coordinates include X-axis, Y-axis, and Z-axis. Can GazeR analyze such data? And we exported the CSV file directly.

jgeller112 commented 1 year ago

To use gazer you must have at a min participant id, trial id, pupil size, blink (you can use whatever algo you would like). you can use make_gazer to get your data in acceptable format to use in gazeR


make_gazer <- function(data, subject="subject", trial="subject", time="time", x="x", y="y", pupil=NULL)

``` . 

It looks like you used Tobii inside the VR? I see the openness column (I believe you could use that as proxy for blinks)
Liujiaxu-Xx commented 1 year ago

Thanks for your reply.     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 04:55 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

To use gazer you must have at a min participant id, trial id, pupil size, blink (you can use whatever algo you would like). you can use: make_gazer <- function(data, subject="subject", trial="subject", time="time", x="x", y="y", pupil=NULL)
to get your data in acceptable format to use in gazeR.

It looks like you used Tobii inside the VR? I see the openness column (I believe you could use that as proxy for blinks)

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

jgeller112 commented 1 year ago

I want to add that this would only work for analyzing pupil data. The gaze function would probably not work here.

Jason Geller, Ph.D.(he/him/his) Lecturer Princeton University Website: www.drjasongeller.com

On Apr 5, 2023, at 8:53 PM, Liujiaxu-Xx @.***> wrote:



Thanks for your reply.     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 04:55 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

To use gazer you must have at a min participant id, trial id, pupil size, blink (you can use whatever algo you would like). you can use: make_gazer <- function(data, subject="subject", trial="subject", time="time", x="x", y="y", pupil=NULL) to get your data in acceptable format to use in gazeR.

It looks like you used Tobii inside the VR? I see the openness column (I believe you could use that as proxy for blinks)

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

— Reply to this email directly, view it on GitHubhttps://github.com/dmirman/gazer/issues/28#issuecomment-1498348050, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEMTQEBSSDRLDO7SL3FSN5LW7YHYRANCNFSM6AAAAAAWTUZ77E. You are receiving this because you commented.Message ID: @.***>

Liujiaxu-Xx commented 1 year ago

This is no way to calculate the gaze time, sweep time?     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 08:55 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

I want to add that this would only work for analyzing pupil data. The gaze function would probably not work here.

Jason Geller, Ph.D.(he/him/his) Lecturer Princeton University Website: www.drjasongeller.com

On Apr 5, 2023, at 8:53 PM, Liujiaxu-Xx @.***> wrote:



Thanks for your reply. &nbsp; &nbsp; ------------------&nbsp;Original&nbsp;------------------ From: @.&gt;; Date: &nbsp;Thu, Apr 6, 2023 04:55 AM To: @.&gt;; Cc: @.&gt;; @.&gt;; Subject: &nbsp;Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

&nbsp;

To use gazer you must have at a min participant id, trial id, pupil size, blink (you can use whatever algo you would like). you can use: make_gazer <- function(data, subject="subject", trial="subject", time="time", x="x", y="y", pupil=NULL) to get your data in acceptable format to use in gazeR.

It looks like you used Tobii inside the VR? I see the openness column (I believe you could use that as proxy for blinks)

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***&gt;

— Reply to this email directly, view it on GitHub<https://github.com/dmirman/gazer/issues/28#issuecomment-1498348050&gt;, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AEMTQEBSSDRLDO7SL3FSN5LW7YHYRANCNFSM6AAAAAAWTUZ77E&gt;. You are receiving this because you commented.Message ID: @.***>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

jgeller112 commented 1 year ago

The gaze features are limited to simple ROI type designs (proportion fixation on certain coordinates). You could probably use the saccades package if you want fixation duration.

jgeller112 commented 1 year ago

I also don't see any message columns. I don't think that is a feature with Tobii SDK for VR?

Liujiaxu-Xx commented 1 year ago

We did not use the Tobii SDK, we used the SRanipal SDK that comes with HTC. then we exported the data by writing C# code.     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 09:19 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

I also don't see any message columns. I don't think that is a feature with Tobii SDK for VR?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

jgeller112 commented 1 year ago

The eye openness column lead me to believe it was Tobii.

Does SRanipal allow output for messages (when things appear on screen or when buttons are pressed)?

Jason Geller, Ph.D.(he/him/his) Lecturer Princeton University Website: www.drjasongeller.com

On Apr 5, 2023, at 9:22 PM, Liujiaxu-Xx @.***> wrote:



We did not use the Tobii SDK, we used the SRanipal SDK that comes with HTC. then we exported the data by writing C# code.     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 09:19 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

I also don't see any message columns. I don't think that is a feature with Tobii SDK for VR?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

— Reply to this email directly, view it on GitHubhttps://github.com/dmirman/gazer/issues/28#issuecomment-1498367489, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AEMTQEDEUBKKPX42ROXSNPDW7YLGPANCNFSM6AAAAAAWTUZ77E. You are receiving this because you commented.Message ID: @.***>

Liujiaxu-Xx commented 1 year ago

SRanipal can only capture information from the eyes, other interactions (button presses, pop-ups) may require other SDKs or writing code.     ------------------ Original ------------------ From: @.>; Date:  Thu, Apr 6, 2023 09:28 AM To: @.>; Cc: @.>; @.>; Subject:  Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

 

The eye openness column lead me to believe it was Tobii.

Does SRanipal allow output for messages (when things appear on screen or when buttons are pressed)?

Jason Geller, Ph.D.(he/him/his) Lecturer Princeton University Website: www.drjasongeller.com

On Apr 5, 2023, at 9:22 PM, Liujiaxu-Xx @.***> wrote:



We did not use the Tobii SDK, we used the SRanipal SDK that comes with HTC. then we exported the data by writing C# code. &nbsp; &nbsp; ------------------&nbsp;Original&nbsp;------------------ From: @.&gt;; Date: &nbsp;Thu, Apr 6, 2023 09:19 AM To: @.&gt;; Cc: @.&gt;; @.&gt;; Subject: &nbsp;Re: [dmirman/gazer] Can GazeR analyze eye movement data in virtual reality environments? (Issue #28)

&nbsp;

I also don't see any message columns. I don't think that is a feature with Tobii SDK for VR?

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***&gt;

— Reply to this email directly, view it on GitHub<https://github.com/dmirman/gazer/issues/28#issuecomment-1498367489&gt;, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AEMTQEDEUBKKPX42ROXSNPDW7YLGPANCNFSM6AAAAAAWTUZ77E&gt;. You are receiving this because you commented.Message ID: @.***>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.***>

elf314 commented 1 month ago

我们没有使用Tobii SDK,我们使用HTC自带的SRanipal SDK。然后通过我们编写的C#代码导出数据。 ------------------原创 ------ - ------------- 来自:@>;日期:2023年4月6日星期四上午09:19 早餐:@ *.>;抄送:@.>; @.>;主题: 回复:[dmirman/gazer] GazeR 可以分析虚拟现实环境中的眼动数据吗?(问题#28)我也没有看到任何消息栏。我不认为这是 Tobii SDK for VR 的功能吗? — 直接回复此电子邮件、在 GitHub 上查看或取消订阅。您收到此消息是因为您创作了该主题。消息 ID:@ .>

你好,我可以问一下关于使用你是怎么使用HTC自带的SRanipal SDK来进行unity的眼动追踪的吗