cognitivecomputations / laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'
Apache License 2.0
227 stars 27 forks source link

Add laser snr math (gsm8k) #3

Closed dgolchin closed 6 months ago

dgolchin commented 6 months ago

This pull request contains an adjusted version of rmt_laser_snr based on math perplexity using the gsm8k dataset. It shortens the processing time and increases the overall performance of the model based on GSM8K.