feat(function-calling): support multi-turn chat completion request for OpenAI

yomorun / yomo

🦖 Stateful Serverless Framework for Geo-distributed Edge AI Infra

https://yomo.run

Apache License 2.0

1.64k stars 129 forks source link

feat(function-calling): support multi-turn chat completion request for OpenAI #758

Closed fanweixiao closed 4 months ago

fanweixiao commented 4 months ago

$ curl -i -X POST -H "Content-Type: application/json" -d '{"prompt":"compare nike and puma website speed"}' http://127.0.0.1:8000/invoke
HTTP/1.1 200 OK
Content-Length: 944
Connection: keep-alive
Content-Type: application/json
Date: Tue, 19 Mar 2024 13:30:14 GMT
Keep-Alive: timeout=4
Proxy-Connection: keep-alive

{
  "Content": "Based on the data provided for the domains nike.com and puma.com which include IP addresses and average latencies, we can infer the following about their website speeds:
  - Nike.com has an IP address of 13.225.183.84 with an average latency of 65.568333 milliseconds.
  - Puma.com has an IP address of 151.101.194.132 with an average latency of 54.563666 milliseconds.

  Comparing these latencies, Puma.com is faster than Nike.com as it has a lower average latency. 

  Please be aware, however, that website speed can be influenced by many factors beyond latency, such as server processing time, content size, and delivery networks among others. To get a more comprehensive understanding of website speed, you would need to consider additional metrics and possibly conductreal-time speed tests.",
  "FinishReason": "stop"
}

vercel[bot] commented 4 months ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

codecov[bot] commented 4 months ago

Codecov Report

Attention: Patch coverage is 0% with 7 lines in your changes are missing coverage. Please review.

Project coverage is 63.91%. Comparing base (e323eaf) to head (4125e34). Report is 1 commits behind head on master.

Files	Patch %	Lines
pkg/bridge/ai/provider/gemini/provider.go	0.00%	3 Missing :warning:
pkg/bridge/ai/provider/azopenai/provider.go	0.00%	2 Missing :warning:
pkg/bridge/ai/provider/openai/provider.go	0.00%	2 Missing :warning:

Additional details and impacted files

```diff @@ Coverage Diff @@ ## master #758 +/- ## ========================================== + Coverage 61.43% 63.91% +2.47% ========================================== Files 45 43 -2 Lines 2653 2497 -156 ========================================== - Hits 1630 1596 -34 + Misses 909 785 -124 - Partials 114 116 +2 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.