If I were rebuilding this project, I would probably move the entirety of model management into a separate repo, which would encapsulate that logic, and expose it via a local API. As it is today, nearly every module makes calls to AI-management functions, which are deeply-wrapped in HuggingFace Transformers logic. Context management is a mess. Much of the early code is just a lot messier than it should be (because I had no idea what I was doing, when I wrote it).
I may get around to fixing this some day, or I might just deal with it. If anyone would like to help work on this, please let me know!
If I were rebuilding this project, I would probably move the entirety of model management into a separate repo, which would encapsulate that logic, and expose it via a local API. As it is today, nearly every module makes calls to AI-management functions, which are deeply-wrapped in HuggingFace Transformers logic. Context management is a mess. Much of the early code is just a lot messier than it should be (because I had no idea what I was doing, when I wrote it).
I may get around to fixing this some day, or I might just deal with it. If anyone would like to help work on this, please let me know!