-
### What Would You Like to See with the Gateway?
https://www.lepton.ai/docs
### Context for your Request
_No response_
### Your Twitter/LinkedIn
_No response_
-
### The Feature
CF has a free offer for this gateway but there are multiple url for each endpoint and one universal entry point [CF link](https://developers.cloudflare.com/ai-gateway). The idea is to…
-
### What Would You Like to See with the Gateway?
Portkey is an extremely exciting AI gateway！and I want to use Alibaba Cloud's Qwen large model through Dashscope. Moreover, Dashscope is already compa…
-
docker pull docker.all-hands.dev/all-hands-ai/runtime:0.13-nikolaik
m@DESKTOP-VKFHU30:~$ sudo docker run -it --privileged --rm --pull=always \
> --network host \
> -e LLM_API_KEY="ollama" \
LLM…
-
## Purpose
Implement new graphql data extraction functionality to populate egress analytics dashboards
## Implementation
1. Get total traffic going out of the gateway
* General analytics
- …
-
### 🚀 The feature, motivation and pitch
There are huge potential in more advanced load balancing strategies tailored for the unique characteristics of AI inference, compared to basic strategies such …
-
## Intro
- 15min Inc Product Update - Hunter
## Status Checks From Last Call
- AuxData
## Open Discussion
AI Job Tester repo
- Should Livepeer take ownership of [AI Job Tester repo](https…
-
Different people have already asked for "their" AI provider to be supported.
It is unlikely that we add support for all of them, but we could switch to a library that allows us to connect to at least…
-
## Why do you need it?
The [transformer](https://github.com/alibaba/higress/tree/main/plugins/wasm-go/extensions/transformer) plugin is being used more frequently, and we hope for better performanc…
-
https://oilbeater.com/2024/08/26/kong-gloo-higress/