Inferring the decoder and encoder of a transformer model in a streaming manner

facebookresearch / fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

MIT License

30.57k stars 6.41k forks source link

Open pengpengtao opened 2 months ago

pengpengtao commented 2 months ago

Is it possible to infer the model separately through encoder.onnx and decoder.onnx?