search

git-cloner / llama2-lora-fine-tuning

llama2 finetuning with deepspeed and lora
https://gitclone.com/aiit/chat/
MIT License
162 stars 14 forks source link

stream_output 是不是没用到呀 #10

Open MarsMeng1994 opened 11 months ago

MarsMeng1994 commented 11 months ago

https://github.com/git-cloner/llama2-lora-fine-tuning/blob/98344720925c832142fb4f59b587231fd5496965/generate.py#L91

little51 commented 11 months ago

是的，没用到，没实现stream方式生成