Accidentally remove RouterArgs parsing is causing the following issue
pydantic.error_wrappers.ValidationError: 2 validation errors for VLLMApp
engine_config
field required (type=value_error.missing)
scaling_config
field required (type=value_error.missing)
Tested locally with following serve config and verified with fix i am able to start server
This seems to have been accidentally removed in previous PR serve config.yaml expects args to be dictionary. See existing readme in ray-llm repo
Accidentally remove RouterArgs parsing is causing the following issue
Tested locally with following serve config and verified with fix i am able to start server
Looks like others are also facing this: https://ray-distributed.slack.com/archives/C053J39MJ3A/p1696320039604519