KomputeProject / kompute

General purpose GPU compute framework built on Vulkan to support 1000s of cross vendor graphics cards (AMD, Qualcomm, NVIDIA & friends). Blazing fast, mobile-enabled, asynchronous and optimized for advanced GPU data processing usecases. Backed by the Linux Foundation.
http://kompute.cc/
Apache License 2.0
1.97k stars 151 forks source link

Integrating contributions from NomicAI for integation to LLama.cpp and GPT4ALL #352

Open axsaucedo opened 8 months ago

axsaucedo commented 8 months ago

@cebtenzzre creating an initial draft PR for integration of contributinos from NomicAI for integation to LLama.cpp and GPT4ALL as part of https://github.com/nomic-ai/gpt4all/issues/1852.

This PR can serve as an opportunity to dive further into some of the requirements, as well as alignment to the newer updates that have been added since, including the extension of the cmake build system.

Changes included in this PR: