katanemo / arch

Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
https://archgw.com
Apache License 2.0
367 stars 19 forks source link

Improve cli #179

Closed adilhafeez closed 1 week ago

adilhafeez commented 1 week ago

sample output from up command,

(venv) ➜  intelligent-prompt-gateway git:(adil/improve_cli) archgw up demos/function_calling/arch_config.yaml
Validating /Users/adilhafeez/src/intelligent-prompt-gateway/demos/function_calling/arch_config.yaml
2024-10-10 16:20:30,468 - cli.main - INFO - Starging arch model server and arch gateway
2024-10-10 16:20:30,471 - cli.core - INFO - archgw_modelserver restart
2024-10-10 16:20:30,553 - model_server.cli - INFO - Stopping model server
2024-10-10 16:20:30,553 - model_server.cli - INFO - Process id file not found, seems like model server was not running
2024-10-10 16:20:30,553 - model_server.cli - INFO - Starting model server - loading some awesomeness, this may take some time :)
2024-10-10 16:20:30,564 - model_server.cli - INFO - Model server started with PID 40348
2024-10-10 16:20:30,575 - cli.core - INFO - Successfull ran model_server
2024-10-10 16:20:30,575 - cli.core - INFO - Starting arch gateway
2024-10-10 16:20:31,118 - cli.core - INFO - Arch docker-compose started in detached.
2024-10-10 16:20:31,209 - cli.utils - INFO - Service Name              State                Ports
2024-10-10 16:20:31,209 - cli.utils - INFO - ========================================================================
2024-10-10 16:20:31,209 - cli.utils - INFO - archgw                    running              0.0.0.0:10000->10000/tcp,
2024-10-10 16:20:31,209 - cli.core - INFO - Arch gateway is up and running!
(venv) ➜  intelligent-prompt-gateway git:(adil/improve_cli)

Here is output from logs command

(venv) ➜  tools git:(adil/improve_cli) ✗ archgw logs --service archgw | tail
...
archgw-1  | [2024-10-10 23:35:31.854][8][info][main] [source/server/drain_manager_impl.cc:208] shutting down parent after drain

(venv) ➜  tools git:(adil/improve_cli) ✗ archgw logs --service model_server | tail
2024-10-10 16:20:48,089 - INFO - Devices Avialble: mps

(venv) ➜  tools git:(adil/improve_cli) ✗