ai-bot-pro / achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local and remote to run; if u run achatbot by yourself, u can learn more, star and fork to contribute~
BSD 3-Clause "New" or "Revised" License
15 stars 2 forks source link

fix: remote-queue-chat #14

Closed weedge closed 4 months ago

weedge commented 4 months ago

fix:

run:

or use wake word

TTS_TAG=tts_edge \ REDIS_PASSWORD= SEND_KEY= \ RUN_OP=fe \ RECORDER_TAG=wakeword_rms_recorder \ python -m src.cmd.remote-queue-chat.generate_audio2audio > ./log/fe_std_out.log

- be on cpu:

TQDM_DISABLE=True \ ASR_TAG=whisper_faster_asr \ ASR_MODEL_NAME_OR_PATH=./models/Systran/faster-whisper-base \ REDIS_PASSWORD= SEND_KEY= \ RUN_OP=be \ TTS_TAG=tts_edge \ LLM_MODEL_NAME=qwen \ LLM_MODEL_PATH=./models/qwen2-1_5b-instruct-q8_0.gguf \ python -m src.cmd.remote-queue-chat.generate_audio2audio > ./log/be_std_out.log


- be on gpu with local asr -> llm -> tts:

qwen1.5

ASR_TAG=whisper_faster_asr \ ASR_MODEL_NAME_OR_PATH=./models/Systran/faster-whisper-base \ REDIS_PASSWORD=$redis_pwd SEND_KEY=*** \ RUN_OP=be \ TQDM_DISABLE=True \ TTS_TAG=tts_coqui \ N_GPU_LAYERS=33 FLASH_ATTN=1 \ LLM_MODEL_NAME=qwen \ LLM_MODEL_PATH=./models/qwen1_5-7b-chat-q8_0.gguf \ python -m src.cmd.remote-queue-chat.generate_audio2audio > ./log/be_std_out.log

qwen2

TQDM_DISABLE=True \ ASR_TAG=whisper_faster_asr \ ASR_MODEL_NAME_OR_PATH=./models/Systran/faster-whisper-base \ REDIS_PASSWORD=$redis_pwd SEND_KEY=*** \ RUN_OP=be \ TTS_TAG=tts_coqui \ N_GPU_LAYERS=29 FLASH_ATTN=1 \ LLM_MODEL_NAME=qwen \ LLM_MODEL_PATH=./models/qwen2-1_5b-instruct-q8_0.gguf \ python -m src.cmd.remote-queue-chat.generate_audio2audio > ./log/be_std_out.log