Lightning-AI / litgpt

Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
https://lightning.ai
Apache License 2.0
6.95k stars 733 forks source link

Fix top-p test #1389

Closed carmocca closed 3 weeks ago

carmocca commented 3 weeks ago

Fixes https://github.com/Lightning-AI/litgpt/pull/1360/files#r1590753388