-
使用更改GitHub代码的方式更改模型，代码中更改了Llama 3.1，写法符合cloudflare模型和项目模型的格式。在重新部署后无法使用新模型
-
i obtain an error when lm_eval try to save result in file.
lm_eval uses model_args to do the file name but it don't remove the ':' character
the error:
Traceback (most recent call last):
Fil…
-
When selecting OpenRouter as AI provider, the selected model isn't persisted across reloads. After clicking "Yes" on the Custom Endpoint Reconnect modal, it will always falls back to the default "mis…
-
A new set of 7b foundational models that claim to beat all 13b Llama 2 models in benchmarks.
https://huggingface.co/mistralai/Mistral-7B-v0.1
https://huggingface.co/mistralai/Mistral-7B-Instruct-v…
-
Hi, thanks for your amazing work, I am running into a bug and I would appreciate it if you could help me.
I recently bough an Intel Arc A770 16GB and I'm triying to run this container. I'm using Ub…
-
I would like support the following architectures:
- Mamba
- MambaByte
- Mamba-2
- Mamba-hybrid (mamba + transformer)
- Mamba-2-hybrid (mamba2 + transformer)
These architectures are becoming qu…
-
Unsloth: Merging 4bit and LoRA weights to 16bit...
Unsloth: Will use up to 23.73 out of 50.99 RAM for saving.
100%|██████████| 32/32 [00:19 4 if True: model.push_to_hub_gguf("mINE", tokenizer, quant…
-
Appreciate for the great work? I tried to run MCTS* search following README and I wonder what VALUE_MODEL_STATE_DICT is.
Besides, I notice that you upload a model on HF, 'zd21/ReST-MCTS-Llama3-8b-In…
dszpr updated
3 weeks ago
-
Considering I have metered internet and not so great resources, I followed your guind and the notebook.
I used this yaml:
```
slices:
- sources:
- model: mistralai/Mistral-7B-Instruct-v0.…
-
i am trying to run PrivateGPT for the first time. I have installed Llama and a service is running at the moment.
I have cloned the repo, install the poetry dependencies (`poetry install --extras "ui…