Arch is an intelligent prompt gateway. Engineered with (fast) LLMs for the secure handling, robust observability, and seamless integration of prompts with APIs - all outside business logic. Built by the core contributors of Envoy proxy, on Envoy.
Sometimes modelserver is not restarted on archgw down command. This results in modelserver running with old codebase. Correct thing to do here is to restart model server on archgw up command.
Sometimes modelserver is not restarted on
archgw downcommand. This results in modelserver running with old codebase. Correct thing to do here is to restart model server onarchgw upcommand.