search

ms-iot / ros_msft_mrtk

This repository contains ROS2 bindings for the Mixed Reality Toolkit - allowing you to create VR and AR applications which reflect sensor data from a Robot or provide command and control
MIT License
65 stars 10 forks source link

Usage Guide #12

Closed userint closed 2 years ago

userint commented 3 years ago

Hi,

Thank you for the hard work that has gone into these projects. I'm attempting to follow the instructions provided to get ROS2 Foxy setup and compiled for mixed reality targeting the Hololens 2. My understanding of the process is as follows:

  1. Install ROS2 Foxy for Windows
  2. Compile ROS# for UWP
  3. Bootstrap the example Unity project (possibly add references to compiled DLL's)

Is this correct or is there something that I am missing? Thank you in advance for any assistance.

ooeygui commented 3 years ago

Thank you for your interest - We are still in the process of bringing this up. We're in the process of migrating to Foxy, and will bring up ROS2.net next, and rebuild the app demos on top of it.

userint commented 3 years ago

@ooeygui Really appreciate the rapid response. I'm not too concerned about the ROS distro to be honest, is it at all possible to utilize Eloquent for the time being and if so, how would one go about the process? Let me know if there's any way that I can be of assistance with the migration.

ooeygui commented 3 years ago

There are two repos which make up the MRTK for ROS2 - this one is the "Unity" side, then there is the native side. The Unity Side includes the UI elements (and will contain more in the future). The native side is located at http://github.com/ms-iot/ros_msft_mrtk_native.

Setting it up to work has been a problem (and the documentation isn't complete for the "in development" way).

However, I'm actively working on making it easy to consume - including adding a Unity Package Manager package and a nuget package (for just the native side, including if you wanted to use unreal).

Here's the inprogress update to Foxy: https://github.com/ms-iot/ros_msft_mrtk_native/pull/5

I'll revisit this repo when we have the UPM working.

userint commented 3 years ago

Awesome. Thank you. I tried to pull the NuGet package using the package source in your readme for the native project and receive the following error:

Severity Code Description Project File Line Suppression State Error Failed to retrieve information about 'Microsoft.ROS.MRTK.Eloquent' from remote source 'https://aka.ms/ros/public/FindPackagesById()?id='Microsoft.ROS.MRTK.Eloquent'&semVerLevel=2.0.0'. The content at 'https://aka.ms/ros/public/FindPackagesById()?id='Microsoft.ROS.MRTK.Eloquent'&semVerLevel=2.0.0' is not valid XML. For security reasons DTD is prohibited in this XML document. To enable DTD processing set the DtdProcessing property on XmlReaderSettings to Parse and pass the settings into XmlReader.Create method.

Am I able to install/build without using UPM or nuget? Thanks again!

ooeygui commented 3 years ago

The native repository contains the repo needed to build ROS2 Eloquent. This repo has scripts to copy the output into a unity application. You can run it in the Unity simulator. Deploying to the hololens was problematic because of the metadata, which is why we abandoned the nuget package and are working on the Unity Package Manager approach.

I need about a week or so to get it ready for consumption.

hwhite-eng commented 3 years ago

Hi @ooeygui ooeygui, I also get the same error about DTD processing when trying to build the foxy mrtk

Is there any news on when this will be available as nuget / UPM and /or a solution to fix building

Thanks

ooeygui commented 2 years ago

I've updated the usage guide and published binaries to use! Please join the discussion if you use it!