Closed shahules786 closed 1 year ago
Added perplexity evaluation for evaluating models. Used to compare different fine-tuned models/ techniques for a larger context.
:x: pre-commit failed. Please run pre-commit run --all-files locally and commit the changes. Find more information in the repository's CONTRIBUTING.md
pre-commit run --all-files
Added perplexity evaluation for evaluating models. Used to compare different fine-tuned models/ techniques for a larger context.