irthomasthomas / undecidability

2 stars 1 forks source link

jcmccormick/runtts: Shell tool to prompt ollama and whisper cli programs #443

Open irthomasthomas opened 4 months ago

irthomasthomas commented 4 months ago

RunTTS

POSIX-compliant shell utility for working with local LLM + voice models

Requirements

To use your desired models with Ollama and TTS, configure them and note their model names as you would use with ollama run xxxx or tts --model_name xxxx. Upon running RunTTS for the first time, go into the configuration menu and enter in the model names you are using.

Install

  1. Clone the repo into ~/runtts.
  2. chmod +x ~/runtts/runtts
  3. ~/runtts/runtts to start the program.

About

This tool is a mashup of the whisper, tts, and ollama CLIs to provide a local utility for interacting with AI models. RunTTS keeps track of a running context as you continue prompting it, and when needed, conversations can be saved for later prompting.

Due to the variability of situations where models can be run, RunTTS utilizes streaming responses to produce audio clips as soon as newline-delimited content is ready. Furthermore, it will handle markdown style triple-backtick blocks, setting them aside to not be read aloud, but can be viewed as received.

Suggested labels

{ "label-name": "AI-tools", "description": "Tools for working with AI models in a local environment", "confidence": 84.96 }