Closed bkorycki closed 1 week ago
Users must now specify the vllm endpoint urls in the secrets config file instead of setting environment variables i.e.:
[lg3_lora_vllm] endpoint_url=<url> api_key = <key> [mistral_7b_vllm] endpoint_url=<url> api_key = <key>
MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅
Users must now specify the vllm endpoint urls in the secrets config file instead of setting environment variables i.e.: