ultravioletrs / cube

Cube AI - LLM protection with TEEs
Apache License 2.0
11 stars 1 forks source link

Feature: Setup Traefik with MG Auth #9

Closed drasko closed 2 months ago

drasko commented 2 months ago

Is your feature request related to a problem? Please describe.

No

Describe the feature you are requesting, as well as the possible use case(s) for it.

In order to protect inference URL, we can use mProxy, but it would be better to use Trefik, because of several reasons:

Use Traefik Forward Auth and let it communicate with our Auth service for decision.

Indicate the importance of this feature to you.

Must-have

Anything else?

No response

drasko commented 2 months ago

Example of usage: https://rogerwelin.github.io/traefik/api/go/auth/2019/08/19/build-external-api-with-trafik-go.html

drasko commented 2 months ago

While we are there - use Traefik also for TLS termination.

drasko commented 2 months ago

Create a small custom service (similar to mProxy, but without proxying) that talks to Auth via our gRPC client.