search

TheComamba / UnKenny

A FoundryVTT module providing NPCs with artificial intelligence.
MIT License
3 stars 5 forks source link

Make the server and only them host the LLM #18

Closed TheComamba closed 11 months ago

TheComamba commented 1 year ago

The model is loaded in memory on only one computer, and the clients merely send their requests.

Furthermore, the model is not downloaded on every client connect!

Is this possible in foundry?

TheComamba commented 11 months ago

We abandoned this concept. The downloaded models are reasonably small. For objects containing "large" in their name.