yomorun / yomo

🦖 Stateful Serverless Framework for Geo-distributed Edge AI Infra. with function calling support, write once, run on any model.
https://yomo.run
Apache License 2.0
1.65k stars 128 forks source link

feat: add Cloudflare AI Gateway for Azure OpenAI provider #748

Closed fanweixiao closed 5 months ago

fanweixiao commented 5 months ago

Related:

name: ai-zipper
host: 0.0.0.0
port: 9000

auth:
  type: token
  token: <YOMO_TOKEN>

bridge:
  ai:
    server:
      addr: localhost:8000
      provider: cloudflare_azure

    providers:
      cloudflare_azure:
        endpoint: https://gateway.ai.cloudflare.com/v1/<CF_GATEWAY_ID>/<CF_GATEWAY_NAME>
        api_key: <AZURE_API_KEY>
        resource: <AZURE_OPENAI_RESOURCE>
        deployment_id: <AZURE_OPENAI_DEPLOYMENT_ID>
        api_version: 2023-12-01-preview
vercel[bot] commented 5 months ago

@fanweixiao is attempting to deploy a commit to the YoMo Team on Vercel.

A member of the Team first needs to authorize it.

codecov[bot] commented 5 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 58.21%. Comparing base (248ac23) to head (35d688a).

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #748 +/- ## ========================================== - Coverage 58.53% 58.21% -0.33% ========================================== Files 45 45 Lines 3379 3379 ========================================== - Hits 1978 1967 -11 - Misses 1287 1298 +11 Partials 114 114 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.