Project: AR in Slicer - Githubissues

Draft Status

Ready - team will start page creating immediately

Presenter Location

In-person

Key Investigators

Alicia Pose Díez de la Lastra (Universidad Carlos III de Madrid)
Mónica García Sevilla (Universidad Carlos III de Madrid)
Javier Pascau (Universidad Carlos III de Madrid)

Project Description

In previous Project Week events we have already presented our project AR in Slicer. On it, we managed to establish a communication bridge between Microsoft HoloLens 2 and 3D Slicer using OpenIGTLink communication protocol.

To achieve this, we created our own custom-made client-side socket in Unity using C# programming language. Nevertheless, our solution presented some computational limitations and only allowed to send image and geometrical transform messages. Recently, we have found a way to execute python scripts from Unity platform.

The purpose of this project is to explore this methodology to transfer the whole OpenIGTLink protocol, available in Python language, to Unity. Ultimately, we want to offer the possibility to work with the complete set of OpenIGTLink to enable the creation of more complete AR applications.

Objective

Incorporate OpenIGTLink communication protocol defined in Python language into Unity

Approach and Plan

Read existing literature on the utilization of Python in Unity
Transfer Python scripts defining OpenIGTLink protocol to an empty Unity project
Test their functioning in an application similar to the one presented in AR in Slicer - Also available in this GitHub repository.

Progress and Next Steps

We have already identified useful literature regarding this topic.

Illustrations

No response

Background and References