是不支持ptuning之后的模型吗？

alipay / PainlessInferenceAcceleration

Creative Commons Attribution 4.0 International

283 stars 18 forks source link

Closed 13269279918 closed 8 months ago

13269279918 commented 8 months ago

ptuning之后的模型调用generate()之后输出内容和原始模型一致，看起来是没有用到prefix_encoder的样子？

chenliangjyj commented 8 months ago

目前还不支持