qwen系列模型支持 - Githubissues

thunlp / InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

MIT License

269 stars 21 forks source link

Closed fst813 closed 5 months ago

fst813 commented 5 months ago

能否支持下qwen系列模型

huliangbing commented 5 months ago

同问

NaivePawn commented 5 months ago

@fst813 我在patch.py里加了这一段，不知道对不对，实验下来点没降

fst813 commented 5 months ago

@NaivePawn 只加这个不对吧？你跑起来了？

NaivePawn commented 5 months ago

@NaivePawn 只加这个不对吧？你跑起来了？

啥不对？我跑起来了，要用qwen1.5那个

fst813 commented 5 months ago

我跑的不是1.5 跑的qwen，改了很多东西

huliangbing commented 5 months ago

效果如何？