search

microsoft / TransformerCompression

For releasing code related to compression methods for transformers, accompanying our publications
MIT License
356 stars 31 forks source link

Add tests that run experiments #97

Closed myshkov closed 7 months ago

myshkov commented 7 months ago

Add tests that run the perplexity script from the experiments folder and validate the resulting perplexity.

The tests currently include rotating-slicing and saving the model, and loading-slicing a saved model. The tests are run for opt125 and phi-2 models to test the two main code paths.