search

yomorun / yomo

🦖 Stateful Serverless Framework for Geo-distributed Edge AI Infra
https://yomo.run
Apache License 2.0
1.64k stars 128 forks source link

feat(llm-bridge): add ollama provider with mistral model support #834

Closed wujunzhuo closed 3 weeks ago

wujunzhuo commented 1 month ago

Description

By using the Ollama backend provider and MistralAI models, users could build up the function calling system with all open-source deps from zero.

vercel[bot] commented 1 month ago

@wujunzhuo is attempting to deploy a commit to the YoMo Team on Vercel.

A member of the Team first needs to authorize it.

codecov[bot] commented 1 month ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 64.61%. Comparing base (ab56d6d) to head (e334b44).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #834 +/- ## ========================================== - Coverage 64.72% 64.61% -0.12% ========================================== Files 45 45 Lines 2648 2648 ========================================== - Hits 1714 1711 -3 - Misses 821 824 +3 Partials 113 113 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

venjiang commented 3 weeks ago

Usage needs to be implemented, used by prompt_eval_count and eval_count, see ollama API