cognitivecomputations / laserRMT

This is our own implementation of 'Layer Selective Rank Reduction'
Apache License 2.0
227 stars 27 forks source link

propose examples folder with the laser-dolphin-mixtral-2x7b process outlined #2

Closed tdolan21 closed 6 months ago

tdolan21 commented 6 months ago

This is my notebook with the process to complete laser-dolphin-mixtral-2x7b. The notebook contains two different methods both using laser, but method 2 begins to be out of scope for this repository. Method 1 is a standard use case and many models can apply the same process.

Please review it and determine if you think its too far out of scope or pertinent to the task at hand. If you have any suggestions I can alter the notebook and make another pull request.

Thanks again!