Open FrankLeeeee opened 2 years ago
Need to provide an example of doing inference, this should be synced in the documentation as well.
The feature depends on https://github.com/hpcaitech/ColossalAI/issues/256
I recommend you to use the Easy and Efficient Transformer(EET) for inference.
Need to provide an example of doing inference, this should be synced in the documentation as well.