Closed Latrolage closed 1 year ago
I used python -m transformers.models.marian.convert_marian_to_pytorch --src folder_with_original_weights --dest new_folder
and then used
tokenizer = AutoTokenizer.from_pretrained(folder) model = AutoModelForSeq2SeqLM.from_pretrained(folder)
where folder is new_folder
I've converted to pytorch with https://github.com/huggingface/transformers/raw/main/src/transformers/models/marian/convert_marian_to_pytorch.py, but I don't know what to write to run it. I have the files "config.json generation_config.json pytorch_model.bin source.spm special_tokens_map.json target.spm tokenizer_config.json vocab.json" but i don't know how to run a pytorch model