AI Proxy Wasm Plugin Integration with GitHub Models

imp2002 commented 2 months ago

https://docs.github.com/en/github-models/prototyping-with-ai-models https://github.com/marketplace/models/azure-openai/gpt-4o

curl -X POST "https://models.inference.ai.azure.com/chat/completions" \
    -H "Content-Type: application/json" \
    -H "Authorization: Bearer $GITHUB_TOKEN" \
    -d '{
        "messages": [
            {
                "role": "system",
                "content": "You are a helpful assistant."
            },
            {
                "role": "user",
                "content": "What is the capital of France?"
            }
        ],
        "model": "gpt-4o"
    }'

ref: https://github.com/alibaba/higress/issues/940

johnlanni commented 2 months ago

Are you interested in implementing this? It doesn't seem complicated.

hackerYHT commented 1 month ago

这个对接任务，我这边来开发吧麻烦帮忙分配下

alibaba / higress

AI Proxy Wasm Plugin Integration with GitHub Models #1304