Hi, All:
Trying out databricks DBRX with ray-llm, first order of business seems to copy and paste two yaml files (serve-config and model-config), and change names and configuration etc. manually.
Looking at all files in the serve-config and model folder per model, reflecting on some yaml templating work we have done similarly, hope to achieve "Generating all yaml files per model, based on a baseline template and model specific parameters.".
Any thoughts? can branch a new feature and show the basic ideas. let me know.
Hi, All: Trying out databricks DBRX with ray-llm, first order of business seems to copy and paste two yaml files (serve-config and model-config), and change names and configuration etc. manually.
Looking at all files in the serve-config and model folder per model, reflecting on some yaml templating work we have done similarly, hope to achieve "Generating all yaml files per model, based on a baseline template and model specific parameters.".
Any thoughts? can branch a new feature and show the basic ideas. let me know.
Thanks,