-
In section 2.5, models are continued fine-tuned on several opensource instruction tuning datasets, which includes the training set of GSM8K and MATH.
I'm wondering after continued fine-tuning, are …
-
Thanks for your great work!
-
As in
https://github.com/daanzu/kaldi-active-grammar/issues/33
https://github.com/gooofy/zamia-speech/issues/106
-
Is there currently a way to fine-tune an existing model with k-diffusion? And/or are there any existing large pre-trained models that would be compatible with the patch feature?
-
Instead of having them fixed, get them dynamycally:
```
// Thanks to Zibri for this routine.
async function getPreferredModel(apiKey) {
try {
…
-
I tried using SentenceTransformer with a couple of models including roberta-base-nli-stsb-mean-tokens to do semantic search(cosine similarity), but I didn't get encouraging results.
I wanted to see …
-
Some popular image models like Mask-RCNN for object detection calculate the loss in a slightly different way:
```python
loss_dict = model(images, targets)
losses = sum(loss for loss in loss_dict…
-
Is there a plan to support PEFT methods like LoRA training in maxtext to support larger model fine-tuning / continue pretraining so that bigger models like LLaMA-3-70B can be trainined even with small…
-
**Following the readme.md, I tried to run RAP for gsm8k using exllama, with the recommended instruction:**
`CUDA_VISIBLE_DEVICES=0,1 python examples/RAP/gsm8k/inference.py --base_lm exllama --exlla…
-
### Feature request
Seems that there is no config for DeBERTa v1-2-3 as decoder (while there are configs for BERT/RoBERTa et similia models)... This is needed in order to perform TSDAE unsupervised…