search

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Provide an Example for Inference #31

Open FrankLeeeee opened 2 years ago

FrankLeeeee commented 2 years ago

Need to provide an example of doing inference, this should be synced in the documentation as well.

binmakeswell commented 2 years ago

The feature depends on https://github.com/hpcaitech/ColossalAI/issues/256

GongZhengLi commented 2 years ago

I recommend you to use the Easy and Efficient Transformer(EET) for inference.