Bump go-skynet/local-ai from v2.0.0-ffmpeg-core to v2.7.0-ffmpeg-core

[dependabot[bot]]

Bumps go-skynet/local-ai from v2.0.0-ffmpeg-core to v2.7.0-ffmpeg-core.

Release notes

Sourced from go-skynet/local-ai's releases.

v2.7.0

This release adds support to the transformer backend for LLM as well!

For now instance you can run codellama-7b with transformers with:

docker run -ti -p 8080:8080 --gpus all localai/localai:v2.7.0-cublas-cuda12 codellama-7b

In the quickstart there are more examples available https://localai.io/basics/getting_started/#running-models.

Note: As llama.cpp is ongoing with changes that could possible cause breakage, this release does not includes changes from https://github.com/ggerganov/llama.cpp/discussions/5138 (the future versions will).

What's Changed

Bug fixes :bug:

• fix(paths): automatically create paths by @​mudler in mudler/LocalAI#1650

Exciting New Features 🎉

• feat(transformers): support also text generation by @​mudler in mudler/LocalAI#1630
• transformers: correctly load automodels by @​mudler in mudler/LocalAI#1643
• feat(startup): fetch model definition remotely by @​mudler in mudler/LocalAI#1654

👒 Dependencies

• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1642
• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1644
• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1652
• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1655

Other Changes

• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1632
• :arrow_up: Update docs version mudler/LocalAI by @​localai-bot in mudler/LocalAI#1631

Full Changelog: https://github.com/mudler/LocalAI/compare/v2.6.1...v2.6.2

v2.6.1

This is a patch release containing bug-fixes around parallel request support with llama.cpp models.

What's Changed

Bug fixes :bug:

• fix(llama.cpp): Enable parallel requests by @​tauven in mudler/LocalAI#1616
• fix(llama.cpp): enable cont batching when parallel is set by @​mudler in mudler/LocalAI#1622

Exciting New Features 🎉

• feat(grpc): backend SPI pluggable in embedding mode by @​coyzeng in mudler/LocalAI#1621

👒 Dependencies

• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1623

Other Changes

• :arrow_up: Update docs version mudler/LocalAI by @​localai-bot in mudler/LocalAI#1619
• :arrow_up: Update ggerganov/llama.cpp by @​localai-bot in mudler/LocalAI#1620

... (truncated)

Commits

• abd678e :arrow_up: Update ggerganov/llama.cpp (#1655)
• 6ac5d81 feat(startup): fetch model definition remotely (#1654)
• f928899 :arrow_up: Update ggerganov/llama.cpp (#1652)
• 5a6fd98 fix(paths): automatically create paths (#1650)
• 072f71d Update codellama-7b.yaml
• 670cee8 Update transformers-tinyllama.yaml
• 9f1be45 Update quickstart.md
• f1846ae Update phi-2.yaml
• ac19998 :arrow_up: Update ggerganov/llama.cpp (#1644)
• cb75127 transformers: correctly load automodels (#1643)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

The following labels could not be found: 3. to review, dependencies.

[dependabot[bot]]

Superseded by #21.