-
### 🚀 The feature, motivation and pitch
we're working towards using vllm for a large-scale deployment with Automatic Prefix Caching enabled. the issue with that in our use-case we want to have the sa…
lun-4 updated
3 weeks ago
-
I recently have come across this tool https://docs.ngpvan.com/reference/introspection by NGP VAN that has helped us check both the connection and the key permissions. It has been helpful when checki…
-
`prisma introspect` recently added Introspection Warning messages to communicate to the user about guardrails that were applied during Introspection. This currently looks like this:
*: *Implement an HTTP Filter to verify external token*
*Description*:
> Allow external OAuth2/OIDC token to be valided via the Token Introspection api in order for e…