devflowinc / trieve

All-in-one infrastructure for search, recommendations, RAG, and analytics offered via API
https://dashboard.trieve.ai
Other
1.32k stars 114 forks source link

docs: guide for local development of kubernetes #1554

Closed cdxker closed 1 month ago

cdxker commented 3 months ago

Description

Research best tool for local kube

kind seems to be the best. Aside from that just a quick setup, and ensure that GPU embedding can work.

Community channels

Matrix is preferred. Reach out on discord or Matrix for further assistance.

cdxker commented 1 month ago

Reopening, as this is still needed

cdxker commented 1 month ago

The only thing that is blocking this from working properly is keycloak being stubborn about ssl. Might need to block out some time to get this working within kubernetes.

It is blocking us from maintaining a proper helm chart since there is no way to test yaml files locally without deploying it to production.

skeptrunedev commented 1 month ago

The only thing that is blocking this from working properly is keycloak being stubborn about ssl. Might need to block out some time to get this working within kubernetes.

It is blocking us from maintaining a proper helm chart since there is no way to test yaml files locally without deploying it to production.

Does setting KC_PROXY to edge help?

cdxker commented 1 month ago

I forgot the context, tested it out months ago back in May with EKS and gave up. Going to start out with this https://www.keycloak.org/getting-started/getting-started-kube and see how it goes.

cdxker commented 1 month ago

Related issue that we've been facing

Found something very useful that came out in June https://github.com/keycloak/keycloak/releases/tag/25.0.0.

They introduced new Hostname Options

New Hostname options In response to the complexity and lack of intuitiveness experienced with previous hostname configuration settings, we are proud to introduce Hostname v2 options.
We have listened to your feedback, tackled the tricky issues, and created a smoother experience for managing hostname configuration. Be aware that even the behavior behind these options has changed and requires your attention - if you are dealing with custom hostname settings.
Hostname v2 options are supported by default, as the old hostname options are deprecated and will be removed in the following releases. You should migrate to them as soon as possible. New options are activated by default, so Keycloak will not recognize the old ones.

For information on how to migrate, see the Upgrading Guide.

cdxker commented 1 month ago

https://github.com/ramosbugs/openidconnect-rs/issues/75#issuecomment-1167924180

Seems like the maintainers for the openidconnect-rs crate don't want to add support for back channel urls which is what is blocking us here.