search

google-ar / arcore-unity-extensions

Google ARCore Extensions and Geospatial Creator for Unity's AR Foundation
Other
335 stars 94 forks source link

Scene Semantic API is not correctly working when I hold the smartphone horizontally. #204

Open ForJobOk opened 1 week ago

ForJobOk commented 1 week ago

I tried using Scene Semantic API when I hold the smartphone horizontally, but it didn't correctly work.

I changed Orientation at player settings, it didn't relevant to the issue. I had my doubts about my implementation, but the same problem occurred with the samples you guys have published.

Sample : https://github.com/google-ar/demo-megagolf Your sample movie : https://github.com/google-ar/arcore-unity-extensions/assets/41860455/1ee42134-7abe-40c3-8213-70599593e445

Of cource, I know Scene Semantic API don't support holding the smartphone horizontally. However, I don't believe the behavior shown in the video is correct.

Version

Unity 2022.3.24f1 ARCore Extensions 1.42.0 AR Foundation 5.1.3

15kingben commented 1 week ago

This is the expected behavior, the semantics model dimensions are fixed to match the horizontal camera image aspect ratio (4:3 portrait). When the phone is held landscape, the semantics model is run on a portrait crop of the landscape camera image.

ForJobOk commented 6 days ago

@15kingben Thank you for your reply.

Are you saying there is no way to solve this problem?

15kingben commented 5 days ago

Yes, currently using semantics horizontally requires the empty spaces on the sides.

ForJobOk commented 4 days ago

@15kingben OK. Do you have a plan updating to use horizontal?

Or we need API to be notified when the empty space occurs on the sides.

One might assume that implementers should control that when the device is rotated, but that confuses us, because the empty space on the sides occurs even in portrait mode in Unity settings.