I have trained vit model for classification.how to speed it by lightseq?tks

[zjersey]

If the model is trained by huggingface, you can refer to inference example for inference speed up.