kssteven418 / BigLittleDecoder

[NeurIPS'23] Speculative Decoding with Big Little Decoder
https://arxiv.org/pdf/2302.07863.pdf
Apache License 2.0
85 stars 10 forks source link

[Solved] Missing 'T5BiLDModel' in the official transformers packages. #6

Closed manyuanbin closed 5 months ago

manyuanbin commented 5 months ago

System Info

ImportError: cannot import name 'T5BiLDModel' from 'transformers.models.t5.modeling_t5' when run_bild_translation.py

Who can help?

No response

Information

Tasks

Reproduction

CUDA_VISIBLE_DEVICES=0 python run_bild_translation.py --model bild --small ../../models/mT5-small-iwslt2017-de-en.bin --large ../../models/mT5-large-iwslt2017-de-en.bin --dataset_name iwslt2017 --dataset_config iwslt2017-de-en --source_lang de --target_lang en --bild_rollback 3 --bild_fallback 2

Expected behavior

build successfully

manyuanbin commented 5 months ago

python -m pip install -e .