feat: GPU Vulkan support

edgenai / edgen

⚡ Edgen: Local, private GenAI server alternative to OpenAI. No GPU required. Run AI models locally: LLMs (Llama2, Mistral, Mixtral...), Speech-to-text (whisper) and many others.

https://docs.edgen.co/

Apache License 2.0

335 stars 15 forks source link

feat: GPU Vulkan support #16

Closed francis2tm closed 8 months ago