This PR introduces a new Truss example for the DBRX-Instruct model. It includes the creation of a new directory and necessary files such as config.yaml, README.md, and model.py. The model.py file contains the core logic for loading the model and running predictions. The config.yaml file has been updated with the required Python version, dependencies, model metadata, and resource specifications. The README.md file provides an overview of the model, deployment instructions, API details, usage examples, and additional notes on generation parameters and limitations. This setup allows users to deploy the DBRX-Instruct model using Truss and Baseten.
Fixes BT-10520
Tips
If you review this pull request, I will attempt to address your feedback by pushing an update. You may also leave a comment and tag @droid.
linear[bot]
commented
7 months ago
Summary of Changes
This PR introduces a new Truss example for the DBRX-Instruct model. It includes the creation of a new directory and necessary files such as config.yaml, README.md, and model.py. The model.py file contains the core logic for loading the model and running predictions. The config.yaml file has been updated with the required Python version, dependencies, model metadata, and resource specifications. The README.md file provides an overview of the model, deployment instructions, API details, usage examples, and additional notes on generation parameters and limitations. This setup allows users to deploy the DBRX-Instruct model using Truss and Baseten.
Fixes BT-10520
Tips