search

NeonGeckoCom / neon-diana-utils

Scripts and Automation for running Neon DIANA
Other
5 stars 6 forks source link

[FEAT] Allow neon_speech to run offline #69

Closed mikejgray closed 5 months ago

mikejgray commented 5 months ago

Objective

Currently, the neon_speech container will not run without an internet connection. All of the other services load without one, but since neon_speech pulls down a model from HuggingFace on init, the container consistently fails.

Initial Implementation Requirements

Most likely path forward is either to build an image with the model baked in (seems pretty large) or to set the cache directory as a PVC, allowing you to run offline as long as you are online long enough to get the model into a persistent cache.

Other Considerations

No response

mikejgray commented 5 months ago

Looks like the default cache directory is ~/.cache/huggingface/hub

NeonDaniel commented 5 months ago

The neon_speech-defailt_model image should work here, though I believe it's only English for the moment