Closed dependabot[bot] closed 1 year ago
mudler
commented
1 year ago @soleblaze ping, there are quite a bunch of changes related to metal - seems good here from a preliminary check, however can't test on real HW, JFYI if you notice something off after this is merged
soleblaze
commented
1 year ago Worked fine here. Looks like a bit of a speed up as well.
mudler
commented
1 year ago @soleblaze thanks for the (super quick!) feedback!
Bumps llama.cpp from
98ed165toe4caa8d.Commits
e4caa8dci : run when changing only the CUDA sources (#1800)58970a4Leverage mmap for offloading tensors to GPU (#1597)8c0a10emetal : fix failure to load model (#1817)fa84c4bFix issue where interactive mode crashes when input exceeds ctx size (#1789)12b063fFixed WSL cuda's OOM error (#1594)31d2b5fUpdate SHA256SUMS with current hashes for models quantized using q4_0 (#1798)4de0334cmake : fix Metal build (close #1791)3f12231k-quants : GCC12 compilation fix (#1792)303f580metal : fix issue with ggml-metal.metal path. Closes #1769 (#1782)059e990doc : fix wrong address of BLIS.md (#1772)Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting
@dependabot rebase.Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)