search

Unity-Technologies / com.unity.perception

Perception toolkit for sim2real training and validation in Unity
Other
892 stars 172 forks source link

Visualizing Perception datasets with fiftyone #609

Open joshQT1 opened 8 months ago

joshQT1 commented 8 months ago

Hello,

I'm exploring using perception in Unity for creating datasets I'm using Perception 1.0.0 preview.1

I've gone through the phase 1 tutorial for generating object datasets and randomizing them. https://github.com/Unity-Technologies/com.unity.perception/blob/main/com.unity.perception/Documentation%7E/Tutorial/Phase1.md

I'm currently trying to visualize the data I created in the custom pysolotools-fiftyone, I've intsalled fiftyone and prereqs from here: https://github.com/Unity-Technologies/com.unity.perception/blob/main/com.unity.perception/Documentation~/Tutorial/pysolotools-fiftyone.md

But when I try to launch fiftyone using this command,

pysolotools-fiftyone

fiftyone tries to open, the webpage appears, but just gives me a generic message about how to connect to a session, and I get this KeyError and my data does not open...  was wondering if anyone has hit this before? Seems like fiftyone is already getting set to localhost:5151 so I don't think that is the issue.

KeyError: 'instances'

I think this may be caused because my first frame is always blank, is frame 0 always intended to be empty? I tried adjusting the Camera perception script to have it start at frame 1, but that just produces an empty frame and does not spawn the objects or labels.

I've attached a data set with my iteration count set to 1, which gives me to 2 frames an empty one and a frame with the basic objects in it from the tutorial.

solo_26.zip Key_error_instances.txt

Jgunde commented 8 months ago

I was having the same problem while running the Jupyter Notebook that's part of the Pysolotools tutorial. Deleting "sequence.0", duplicating "sequence.1", and renaming it to "sequence.0" worked for me.