After mistral started requiring accepting terms, we need to start including the hf_access_token in secrets.
Note that for the TRT model, the code already sets the hf_access_token if it's in the secrets (it was generated from some template).
Note that I also added a "model_metadata.repo_id" field to the mistral-7b-chat and instruct models as well so that the terms and conditions link shows up properly.
Summary
After mistral started requiring accepting terms, we need to start including the hf_access_token in secrets.
Note that for the TRT model, the code already sets the hf_access_token if it's in the secrets (it was generated from some template).
Note that I also added a "model_metadata.repo_id" field to the mistral-7b-chat and instruct models as well so that the terms and conditions link shows up properly.
Testing
Deployed the model on my account: