This web app is responsible for allowing the user to manipulate the Model Servers (Endpoints) in their Kubeflow cluster. To achieve this it provides a user friendly way to handle the lifecycle of InferenceService
CRs.
The web app currently works with v1beta1
versions of InferenceService
objects.
The web app is installed alongside the other KServe components, either in the kserve
or in the kubeflow
namespace. There is a VirtualService
that exposes the app via an Istio Ingress Gateway. Depending on the installation environment the following Ingress Gateway will be used.
Installation mode | IngressGateway |
---|---|
Standalone KServe | knative-ingress-gateway.knative-serving |
Kubeflow | kubeflow-gateway.kubeflow |
To access the app you will need to navigate with your browser to
${INGRESS_IP}/models/
Alternatively you can access the app via kubectl port-forward
. In that case you will need to configure the app to:
/
prefixYou can apply the mentioned configurations by doing the following commands:
# edit the configmap
# CONFIG=config/overlays/kubeflow/kustomization.yaml
CONFIG=config/base/kustomization.yaml
vim ${CONFIG}
# Add the following env vars to the configMapGenerator's literals
# for kserve-models-web-app-config
- APP_PREFIX=/
- APP_DISABLE_AUTH="True"
- APP_SECURE_COOKIES="False"
# reapply the kustomization
# kustomize build config/overlays/kubeflow | kubectl apply -f -
kustomize build config/base | kubectl apply -f -
The following is a list of ENV var that can be set for any web app that is using this base app. | ENV Var | Default value | Description |
---|---|---|---|
APP_PREFIX | /models | Controls the app's prefix, by setting the base-url element | |
APP_DISABLE_AUTH | False | Controls whether the app should use SubjectAccessReviews to ensure the user is authorized to perform an action | |
APP_SECURE_COOKIES | True | Controls whether the app should use Secure CSRF cookies. By default the app expects to be exposed with https | |
CSRF_SAMESITE | Strict | Controls the SameSite value of the CSRF cookie | |
USERID_HEADER | kubeflow-userid | Header in each request that will contain the username of the logged in user | |
USERID_PREFIX | "" | Prefix to remove from the USERID_HEADER value to extract the logged in user name |
The frontend is build with Angular and the backend is written with the Python Flask framework.
This web app is utilizing common code from the kubeflow/kubeflow repository. We want to enforce the same UX across our different Kubeflow web apps and also keep them in the same development state. In order to achieve this the apps will be using this shared common code.
This will require us to fetch this common code when we want to either build the app locally or in a container image.
In order to run the app locally you will need to:
The npm run build:watch
command will build the frontend artifacts inside the backend's static
folder for serving. So in order to see the app you'll need to start the backend and connect to localhost:5000
.
Requirements:
# build the common library
COMMIT=$(cat ./frontend/COMMIT)
cd $KUBEFLOW_REPO/components/crud-web-apps/common/frontend/kubeflow-common-lib
git checkout $COMMIT
npm i
npm run build
cd dist/kubeflow
npm link
# run the app frontend
cd $KSERVE_MODELS_WEB_APP_REPO/frontend
npm i
npm link kubeflow
npm run build:watch
# create a virtual env and install deps
# https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/
cd $KSERVE_MODELS_WEB_APP_REPO/backend
python3.7 -m pip install --user virtualenv
python3.7 -m venv web-apps-dev
source web-apps-dev/bin/activate
# install the deps on the activated virtual env
KUBEFLOW_REPO="/path/to/kubeflow/kubeflow" make -C backend install-deps
# run the backend
make -C backend run-dev