-
### Please check that this issue hasn't been reported before.
- [X] I searched previous [Bug Reports](https://github.com/OpenAccess-AI-Collective/axolotl/labels/bug) didn't find any similar reports.
…
-
I download the codellama-7B, continue config.json config as this:
{"title": "LocalServer",
"provider": "openai",
"model": "codellama-7b-Instruct",
"apiBase": "http://local…
-
### System Info
Python 3.11.9
trl 0.11.0
transformers 4.45.1
### Information
- [ ] The official example scripts
- [X] My own modified scripts
### Tasks
- [X] An officially supported …
-
在模型上直接进行dpo训练,没有加载sft的lora参数,训练参数如下:
```
src/train_bash.py \
--stage dpo \
--dpo_bet 0.3 \
--model_name_or_path model_path/ \
--do_train \
--dataset pat…
-
Has anyone used Autogen in conjunction with local LLM to create an agent that manages function calls? It seems that this function calling feature integrates seamlessly with OpenAI, but I'm facing chal…
-
Tesla P40 performance is still very low, only using 80W underload.
Any process on exllama todo "Look into improving P40 performance"?
env:
```sh
kernel: 6.1.53-x64v3-xanmod1
system: "Linux Mint 2…
-
- [ ] [unsloth/README.md at main · unslothai/unsloth](https://github.com/unslothai/unsloth/blob/main/README.md?plain=1)
# unsloth/README.md at main · unslothai/unsloth
…
-
### Before submitting your bug report
- [ ] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [ ] I'm not able to find an [open issue](ht…
-
### What is the issue?
Every model I tested with ollama runs fine, but when trying: `ollama run codellama:34b`, I get `Error: llama runner process has terminated: signal: segmentation fault (core dum…
-
## Description
I am using the jupyter ai extension with a custom model provider as per steps in https://jupyter-ai.readthedocs.io/en/latest/users/index.html#custom-model-providers
I have not m…