search

microsoft / LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs
https://aka.ms/GeneralAI
MIT License
3.6k stars 274 forks source link

MiniLLM: logit_processor generation fix in the model parallel setup #125

Closed artsobolev closed 9 months ago

artsobolev commented 9 months ago

Currently this line is overwritten by the next one.