Closed alarm109 closed 10 months ago
Hey! Thanks for the report, are you saying the orientation
prop never changes? Not even if your app rotates?
Yes, I changed in deployment info to just Portrait
or just Landscape
to check. The frame's orientation
stayed the same. I always seem to get orientation
value "right".
If this is always the case, my guess would be that maybe the frame is generated in the incorrect orientation. Therefore even if I put the correct orientation to MLKit it still gives back incorrect answer, because the buffer is generated incorrectly? Could be completely wrong, because I don't really know how the frames are generated in this case
Hi there! Is this fixed? Because it is happening to me as well using mlkit for object detection. It works even upside down, but not portrait mode.
Hey - is this still an issue? I think orientation is now just always portrait, I will revisit the Orientation issue once I get enough sponsors for that as it is quite compelx to solve it once and for all
Hey - I'm tracking Orientation in this feature request/issue now: https://github.com/mrousavy/react-native-vision-camera/issues/1891 ✨
Make sure to upvote or sponsor to support this feature, and leave a comment if you have any additional thoughts/ideas.
What were you trying to do?
I am passing frame to frame processor plugin which uses MLKit. I am trying to label fruits. When the app is in landscape mode it works correctly. But when the app is in portrait mode, I get random labelling when pointing to banana, e.g. "solar dish", "radiator".
After a little debugging. I can see that frame always gives orientation "right" in any position. So maybe the frame is created incorrectly somehow when in portrait mode?
p.s. I'm using local model from tensorflow, but the same issue happens with default MLKit labeling.
Reproduceable Code
What happened instead?
Frame is incorrect, therefore labelling in portrait mode is incorrect.
Relevant log output
No response
Device
iPhone 12 (iOS 15.3.1)
VisionCamera Version
2.12.2
Additional information