issues
search
art-from-the-machine
/
Mantella
Mantella is a Skyrim and Fallout 4 mod which allows you to naturally speak to NPCs using Whisper (speech-to-text), LLMs (text generation), and xVASynth / XTTS (text-to-speech).
https://art-from-the-machine.github.io/Mantella/
GNU General Public License v3.0
164
stars
41
forks
source link
Road to v0.12: Using HTTP to communicate with game
#230
Open
Leidtier
opened
4 months ago
Leidtier
commented
4 months ago
Goals
Eliminate all issues in setup and usage that comes from having to handle files
Setup issues
Encoding issues
Root Builder
Having to cast the spell to make it work
etc.
Being able to easily send any kind of data from and to the game that we like without having to introduce more communication files
Summary of changes
Use HTTP instead of file read/write to communicate between game and
MantellaSoftware
Have SKSE and F4SE plugins that allow the games to communicate with an HTTP server
Change the interaction logic to a server-client communication in which the game is the client that calls the
MantellaSoftware
to get information
MantellaSpell
and
MantellaGun
use a Quest to track the current conversation, updates are received as events
MantellaSoftware
generates and provides packages of information for the game containing information about what happens next
Progress
[x]
Have a feature complete PR for integration into
MantellaSoftware
[x] Have a fallback for games that can not (yet) use HTTP communication
[ ] Have support for debugging
[x]
Have a feature complete PR for integration into
MantellaSpell
[ ] Have support for debugging
[x]
Have a feature complete PR for integration into
MantellaGun
[ ] Have support for debugging
[x]
SKSE_HTTP
: A plugin that allows Skyrim to communicate strongly typed data over HTTP
[x] Skyrim SE
[x] Skyrim AE
[x] Skyrim VR
[x]
F4SE_HTTP
: A plugin that allows Fallout 4 to communicate strongly typed data over HTTP
[x] Fallout 4
[x] Fallout 4 VR
Goals
Summary of changes
Progress