feat: support local llm vision model inference

ai-bot-pro / achatbot

An open source chat bot architecture for voice/vision (and multimodal) assistants, local and remote to run; if u run achatbot by yourself, u can learn more, star and fork to contribute~

BSD 3-Clause "New" or "Revised" License

15 stars 2 forks source link

feat: support local llm vision model inference #58

Closed weedge closed 1 month ago

weedge commented 1 month ago

feat:

add llamacpp minicpm-v-2.6 vision model
add vision_image_frame aggregator and daily_echo_vision_bot daily_describe_vision_bot
add engine_llm_processor tag for get_llm_processor from bot config llm tag

fix:

change ImageRawFrame add mode for PIL.Image