Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
use katanemo/archgw:latest as docker image tag and update archgw build to tag images with katanemo/archgw:latest
rename services => service for archgw cli
improve logging in model server
move cli out from init and placed it into cli.py
rename models from gpt4o to gpt-3.5
add logs command, can also stream logs if you specify --follow option
sample output from up command,
(venv) ➜ intelligent-prompt-gateway git:(adil/improve_cli) archgw up demos/function_calling/arch_config.yaml
Validating /Users/adilhafeez/src/intelligent-prompt-gateway/demos/function_calling/arch_config.yaml
2024-10-10 16:20:30,468 - cli.main - INFO - Starging arch model server and arch gateway
2024-10-10 16:20:30,471 - cli.core - INFO - archgw_modelserver restart
2024-10-10 16:20:30,553 - model_server.cli - INFO - Stopping model server
2024-10-10 16:20:30,553 - model_server.cli - INFO - Process id file not found, seems like model server was not running
2024-10-10 16:20:30,553 - model_server.cli - INFO - Starting model server - loading some awesomeness, this may take some time :)
2024-10-10 16:20:30,564 - model_server.cli - INFO - Model server started with PID 40348
2024-10-10 16:20:30,575 - cli.core - INFO - Successfull ran model_server
2024-10-10 16:20:30,575 - cli.core - INFO - Starting arch gateway
2024-10-10 16:20:31,118 - cli.core - INFO - Arch docker-compose started in detached.
2024-10-10 16:20:31,209 - cli.utils - INFO - Service Name State Ports
2024-10-10 16:20:31,209 - cli.utils - INFO - ========================================================================
2024-10-10 16:20:31,209 - cli.utils - INFO - archgw running 0.0.0.0:10000->10000/tcp,
2024-10-10 16:20:31,209 - cli.core - INFO - Arch gateway is up and running!
(venv) ➜ intelligent-prompt-gateway git:(adil/improve_cli)
--follow
optionsample output from
up
command,Here is output from logs command