search

Utsira / RealityMorpher

Brings Morph Target/ Shape Key/ Blend Shape animations to RealityKit
MIT License
25 stars 2 forks source link

Question: VisionOS / Custom Materials #5

Open philmccarty opened 4 hours ago

philmccarty commented 4 hours ago

Very cool project!

I noticed you pointed out that it certainly won't work with VisionOS because of "Custom Materials",' I'm a bit out of my depth here, but am curious - is there -any- route you can see towards getting Shape Key animations into RealityKit? Is this a "simply impossible" thing or "very difficult" or "kinda tricky?" I'm trying to get a sense of the -scale- of difficulty here. :)

sincerely, Phil

Utsira commented 4 hours ago

Thank you! It looks like this package might have been "sherlocked" in iOS 18/ macOS 15/ VisionOS 2. See the docs here: https://developer.apple.com/documentation/realitykit/blendshapeweightscomponent I've not played with the new APIs yet though

Utsira commented 4 hours ago

Actually, this doc page seems to give the clearest overview of how to use the new API https://developer.apple.com/documentation/realitykit/blendshapeweightsmapping

Utsira commented 4 hours ago

Once I've had a chance to play with it and confirm it does everything RealityMorpher can I'll update the README to indicate that this is now an iOS 17 backfill

philmccarty commented 4 hours ago

Good find! No shame in being Sher-locked. Just means you're ahead of your time. I also saw this: https://forums.developer.apple.com/forums/thread/766484

I haven't had a chance to play with it yet either, I'm very much punching out of my weight class so if you figure it out and are willing to consult I'd be happy to pay you for your time. I suspect I will spend 10 hours sorting what a knowledgable person could tell me in 1.

Utsira commented 3 hours ago

What platforms and os version do you need to target? Just Vision OS? And if so, is Vision OS 2 acceptable as the minimum supported version?

philmccarty commented 3 hours ago

Yep, just Vision OS 2

Utsira commented 3 hours ago

could you DM me please at olidew at gmail dot com?