-
I was trying to use xlora for combining Flan-T5 LoRAs and ran into error within apply_scalings_to_x, does xLoRA support seq2seq models such as Flan-T5 and BART ?
-
### System Info
- `transformers` version: 4.40.0
- Platform: Linux-6.1.58+-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.22.2
- Safetensors version: 0.4.3
- Accele…
-
As one of the models we are looking at for our project, seq2seq needs an issue to work against. We will need to develop a workflow, but at the moment in checklist order:
- [ ] download pre-trained …
-
(pytorch2.0.1zh) zh@inspur:~/TrOCR$ python -m transformers.onnx --model ./cust-data/weights/ --feature=vision2seq-lm --framework=pt --preprocessor=tokenizer --atol 1e-4 hand-write-onnx
usage: Hugging…
-
Hello @ggordonhall ,
I'm really interested in this seq2seq implementation.
When I run it there seems to be a problem with data not being defined?
I've tried `hcat` the batches and zip Xs and Ys tog…
-
### System Info
peft = 0.12.0, accelerate = 0.33.0, transformers=4.43.3, python=3.8.19
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scr…
-
### Describe the feature
Is it not possible yet to train seq2seq model using colossalai? Given scripts are for causalLM models
-
I am trying to migrate a seq2seq model to the framework of timeserio.
The model is at https://github.com/JEddy92/TimeSeries_Seq2Seq/blob/master/notebooks/TS_Seq2Seq_Conv_Full_Exog.ipynb .
For this…
-
Use a seq2seq NLP Model to improve the accuracy of prediction
-
Hi, thank you for your work. But I cannot find model in the seq2seq folder. How to solve it?
Sincerely!