Closed samos123 closed 1 year ago
PR for updating the images: https://github.com/substratusai/images/pull/45 . I will also start updating the examples
Verified on Kind with this model:
apiVersion: substratus.ai/v1
kind: Model
metadata:
name: llama-2-7b
spec:
image: substratusai/model-loader-huggingface:pr-45
#build:
# git:
# url: https://github.com/substratusai/images
# branch: no-param-envs
# path: model-loader-huggingface
env:
HUGGING_FACE_HUB_TOKEN: ${{ secrets.ai.HUGGING_FACE_HUB_TOKEN }}
params:
name: meta-llama/Llama-2-7b-hf
Allow setting environment variables directly from the Substratus resources.
E.g.
This also removes the functionality of Substratus of setting
PARAM_
environment variables. So this will require updating our images and possibly examples.