Closed Nexesenex closed 2 days ago
Courtesy of Johannes Gaessler, as usual. PR came after refactor, but I think that it's important to have it merged now for those using split row.
https://github.com/ggerganov/llama.cpp/pull/8167
Will merge the commit from upstream directly
Courtesy of Johannes Gaessler, as usual. PR came after refactor, but I think that it's important to have it merged now for those using split row.
https://github.com/ggerganov/llama.cpp/pull/8167