-
**Following the readme.md, I tried to run RAP for gsm8k using exllama, with the recommended instruction:**
`CUDA_VISIBLE_DEVICES=0,1 python examples/RAP/gsm8k/inference.py --base_lm exllama --exlla…
-
There has been some community appetite for classification tasks #1249 #1124. Incidentally, due to the use of classification models for RLHF, we already have some of the necessary components to support…
-
Waiting on more stock routes from user.
```
8426de28ebdc65a2|2023-01-27--20-07-53
```
- [ ] Fix tuning/steer scaling
- [ ] Look into other HKG models that are potentially like this
-
In axolotl, there's a config parameter you can set:
`train_on_inputs: false`
It changes the way the loss is calculated when training a lora -> i.e. it ignores the loss on input tokens and only tra…
-
Thanks for your awesome work in model merging! I'm excited about the improvements you achieved compare to other merging methods. However, I saw the individually fine-tuned models still out-perform WEM…
-
Hi,
Thank you for your great work.
If you don't mind, could you provide us with minimal code or instructions to reproduce the results from the paper?
Or, the minimal script to run the code woul…
-
Hi @MaartenGr ,
I am trying to visualise the topic after merging the models but getting an error. Could you please guide me to fix it?
Fitted model using two different datasets:
keybert = K…
-
Hi!
When I queue an image for the first time it takes significantly longer than subsequent requests. It seems like the issue is related to applied providers. It shows antelopev2 and buffalo_l in th…
-
Hi, first of all, thank you so much for providing pre-trained models through many experiments. But what I want to ask is, I want to fine-tune the pre-trained VCTK model with my multi-speaker dataset. …
-
**Is your feature request related to a problem? Please describe.**
I think integrating Fireworks AI is a good choice for enhancing TaskingAI. Fireworks AI offers a platform focused on generative AI, …