Ki6an / fastT5

⚡ boost inference speed of T5 models by 5x & reduce the model size by 3x.
Apache License 2.0
565 stars 72 forks source link

Electra model loading into fastT5 #51

Closed OriAlpha closed 2 years ago

OriAlpha commented 2 years ago

I am trying to use fastT5 library to do some benchmarking, when i try to load model, onnx_model_paths = generate_onnx_representation(trained_model_path)
it gives out error as 'ElectraConfig' object has no attribute 'num_heads' and 'ElectraConfig' object has no attribute 'd_kv'