strangerattractor / Soundvision_PUBLIC

Max's long long journey into the unity world.
Other
12 stars 1 forks source link

Understanding of Realtime Input of Kinect as texture in Unity #70

Closed strangerattractor closed 5 years ago

strangerattractor commented 5 years ago

The udemy course teaches me the basics of game development right now. But I need do understand more quickly how I can apply this live input from the Kinect to a shader.

I think I miss a basic point here.

In slack you wrote: "You get already texture of Kinect image and the shader graph accepts Texture2D."

But I don't see were I get the texture of the Kinect image.

I don't understand the process yet.

Is it a script, is it a material, is it a game object? I understand that I somehow have to ask the Kinect to start recording and then grab the output of that in use it somewhere.

But I don't understand how.

How can I learn this?

chikashimiyama commented 5 years ago

The "Main" scene contains all tricks.

Check the IRPanel Behaviour script attached to IRPanel game object (under Kinect Visualization) You see

kinectManagerBehaviour.KinectSensor.InfraredCamera.Data this line gets the actual Texture2D from the Kinect sensor and pass it to HRDP shader.

chikashimiyama commented 5 years ago

"It's actually not so difficult. but I think I should not help a lot right?" No! why? please help :smile:. I'm afraid I'm still a newborn in Unity. Not even learning to walk yet... I'm more like... what's the first thing babies learn... focusing their eyes maybe?

so I guess you need more instruction on this

chikashimiyama commented 5 years ago

I made a separate demo scene KinectSceneGraph. in the scene, I used the scene graph to modify the color of texture coming from Kinect.

69c5decef2a8cf3b9ba7f706ac20b92d97a7a1b8 include the cnange

strangerattractor commented 5 years ago

Check different usable otpions for Azure Kinect in Unity. https://assetstore.unity.com/packages/tools/integration/azure-kinect-examples-for-unity-149700 If we need to buy this asset, or if it makes sense to buy this asset. let's buy it.

chikashimiyama commented 5 years ago

it may reduce our workload. please buy.

chikashimiyama commented 5 years ago

@strangerattractor Well, I think you already understood how you use Kinect 2 image as a texture. Please close this issue and make a new one for Azure integration.

strangerattractor commented 5 years ago

bought done :-)