hpcaitech / EnergonAI

Large-scale model inference.
Apache License 2.0
630 stars 90 forks source link

Does EnergonAI support accelerated inference for segmenting anything? #219

Open sanbuphy opened 1 year ago

sanbuphy commented 1 year ago

The inference speed of the H model for segmenting anything feels relatively slow. I believe there should be common optimization techniques for transformers. Are there any reference materials available EnergonAI on this topic? Thank you.