-
I'm using the 'Llama-X' (https://github.com/AetherCortex/Llama-X) training code with the vicuna-style chat template to fine-tune the Llama-2-7b-hf model. However, I'm observing an unstable loss during…
-
Hi,
I have a problem with the program which keeps re-downloading the model for every new session. Does anyone knows a fix for this?
(ps. I'm not a programmer please be gentle with the explanatio…
-
Thanks!
-
I could run **“run_localGPT.py”** without any **cuda.OutOfMemory errors**, but when I tried **“run_localGPT_API.py”**, it downloaded a new model and gave me a **cuda.OutOfMemoryError**. How can I fix …
-
Based on the "WizardLM/WizardCoder-15B-V1.0" model, I used 78533 pieces of data to fine-tune the instructions. The dataset format is as follows:
![image](https://github.com/nlpxucan/WizardLM/assets…
-
Hi guys, I just trying to run this and I got few errors:
1) the docs here have a reference to config.json, but I only find a config.py
2) after configure , the config.py and the extension. I got t…
-
I'm probably missing something obvious here, but I can't get the new ContextShift feature to work. I've downloaded the newest koboldcpp version, launched the GUI, selected ContextShift (and deselectet…
-
Thanks for the great repo
i have two questions about training the models (specifically WizardCoder):
1. have you tried training with QLoRa, and not just LoRa ? are you considering adding it to t…
mrT23 updated
8 months ago
-
Hey, no matter what I do (I installed the transformers lib from the git repo directly), this error pops up when trying to load the inference code.
Could you please provide a basic example of how to…
-
Thanks for this project! Which models are supported? Is it just GPT4 or others too?