search

Unity-Technologies / sentis-samples

Sentis samples internal development repository. Contains example and template projects for Sentis package use.
Other
117 stars 21 forks source link

[Sample Request] Could add the Unite sample with the generative chat? #4

Open MunteanuAndreiStefan opened 7 months ago

MunteanuAndreiStefan commented 7 months ago

Hi,

I've seen a great sample at Unite. Could you add an example of Generative AI for smart NPCs with voice recognition?

Thanks, Stefan

LiutaurasVysniauskasUnity commented 7 months ago

Thank you for the suggestion! This is known internally as Task 256

pauldog commented 5 months ago

Hi we have some new models on Hugging Face. This includes a speech-to-text model (Whisper) and a small language model (Tiny Stories) to get you started.

ElectroGamesDev commented 5 months ago

Hi we have some new models on Hugging Face. This includes a speech-to-text model (Whisper) and a small language model (Tiny Stories) to get you started.

Tiny Stories is used to create stories, so its most likely not helpful with creating smart NPCs.

pauldog commented 5 months ago

Hi we have some new models on Hugging Face. This includes a speech-to-text model (Whisper) and a small language model (Tiny Stories) to get you started.

Tiny Stories is used to create stories, so its most likely not helpful with creating smart NPCs.

That's true. Although the same code could be used with other LLMs with very little changes. And there will be some other LLMs up there in the future. And some plans are being considered to release the NPC framework. (Not got a timescale on that yet)

ElectroGamesDev commented 5 months ago

That's true. Although the same code could be used with other LLMs with very little changes. And there will be some other LLMs up there in the future. And some plans are being considered to release the NPC framework. (Not got a timescale on that yet)

How could other LLMs be used with Sentis that aren't in a .sentis file?

pauldog commented 5 months ago

You can convert them