Helsinki-NLP / Tatoeba-Challenge

Other
808 stars 91 forks source link

How am I supposed to run the models? #34

Closed Latrolage closed 1 year ago

Latrolage commented 1 year ago

I've converted to pytorch with https://github.com/huggingface/transformers/raw/main/src/transformers/models/marian/convert_marian_to_pytorch.py, but I don't know what to write to run it. I have the files "config.json generation_config.json pytorch_model.bin source.spm special_tokens_map.json target.spm tokenizer_config.json vocab.json" but i don't know how to run a pytorch model

Latrolage commented 1 year ago

I used python -m transformers.models.marian.convert_marian_to_pytorch --src folder_with_original_weights --dest new_folder and then used tokenizer = AutoTokenizer.from_pretrained(folder) model = AutoModelForSeq2SeqLM.from_pretrained(folder) where folder is new_folder