Refactor the sampling class

theroyallab / tabbyAPI

An OAI compatible exllamav2 API that's both lightweight and fast

GNU Affero General Public License v3.0

503 stars 67 forks source link

Open SecretiveShell opened 3 weeks ago

SecretiveShell commented 3 weeks ago

This PR aims to refactor parts of the sampling to be much more compact.