Enables passing arguments to the kserve agent service.
Testing
cd agent
tox -e pack
tox -e export-to-docker
docker run -ti kserve-agent:0.13.0 -v
Expected output:
docker run -ti kserve-agent:0.13.0 -v
2024-10-16T09:30:29.043Z [pebble] Started daemon.
2024-10-16T09:30:29.053Z [pebble] POST /v1/services 4.336562ms 202
2024-10-16T09:30:29.060Z [pebble] Service "kserve-agent" starting: /ko-app/agent [ -v ]
2024-10-16T09:30:29.111Z [pebble] Change 1 task (Start service "kserve-agent") failed: cannot start service: exited quickly with code 2
2024-10-16T09:30:29.123Z [pebble] GET /v1/changes/1/wait 69.852984ms 200
2024-10-16T09:30:29.124Z [pebble] Started default services with change 1.
The output above shows the -v is passed to the service.
I also published the image to charmedkubeflow/kserve-agent:0.13.0-test-fix-kf-6449 temporarily and tested it in a CKF deployment with the NIMs InferenceService.
The agent container is no longer failing, it started as expected with:
kubectl logs llama3-8b-instruct-1xgpu-predictor-00001-deployment-c9d4d8dcp9s -c agent
2024-10-16T11:00:19.633Z [pebble] Started daemon.
2024-10-16T11:00:19.644Z [pebble] POST /v1/services 5.554277ms 202
2024-10-16T11:00:19.650Z [pebble] Service "kserve-agent" starting: /ko-app/agent [ --enable-puller --config-dir /mnt/configs --model-dir /mnt/models --component-port 8000 ]
2024-10-16T11:00:20.657Z [pebble] GET /v1/changes/1/wait 1.012259778s 200
2024-10-16T11:00:20.657Z [pebble] Started default services with change 1
part of #95
Enables passing arguments to the kserve agent service.
Testing
Expected output:
The output above shows the
-vis passed to the service.I also published the image to
charmedkubeflow/kserve-agent:0.13.0-test-fix-kf-6449temporarily and tested it in a CKF deployment with the NIMs InferenceService. Theagentcontainer is no longer failing, it started as expected with: