tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment
https://tunib-ai.github.io/parallelformers
Apache License 2.0
776 stars 61 forks source link

EncoderDecoder support #26

Open d-miketa opened 2 years ago

d-miketa commented 2 years ago

Hi, I'm very interested in this work, looks super interesting and useful. Unfortunately one of my models is an EncoderDecoder model and I have no idea how to get it to work. Your FAQ makes it clear I'd have to implement a custom Policy, but it's not clear to me where to start. Do you have an example that one could follow? Is this something that needs to be different for each individual EncoderDecoderModel or can it be automated?