search

KomputeProject / kompute

General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
http://kompute.cc/
Apache License 2.0
1.97k stars 151 forks source link

State of the Project #344

Closed lukas-the-wizard closed 8 months ago

lukas-the-wizard commented 8 months ago

Is it maintained? Should software be build or depending on this?

llama.cpp potentially using this project https://github.com/ggerganov/llama.cpp/pull/4456

this project already using it https://github.com/nomic-ai/gpt4all

tikikun commented 8 months ago

I think this project is very potential for future AI usecase given nomic ai implementation using Vulkan + Kompute giving very good result

axsaucedo commented 8 months ago

Exciting to see that GPU4all is using Kompute! The project is stil maintained and is backed by the Linux Foundation as part of the projects in the LF AI & Data. In the past we worked closely with previous authors that integrated Kompute, so we would be open to explore opportunities if functionalities are missing or issues arise.

axsaucedo commented 8 months ago

We have opened https://github.com/nomic-ai/gpt4all/issues/1852 support contributions across the GPT4All project as well as upstream contributions to bring some of these extensions