AI-Guru / helibrunna

A HuggingFace compatible Small Language Model trainer.
GNU Affero General Public License v3.0
73 stars 7 forks source link

PPL and logits display #4

Open gakingk opened 1 month ago

gakingk commented 1 month ago

Hello @AI-Guru, is there any built-in way to show a trained xLSTM model's PPL given a prompt and give the probabilities of the predicted tokens? I am using this framework for academic purposes, and having some data on these things would be great for better visualization. Also, does this project have a bibtex citation file?

Thanks in advance!