search

hltcoe / sandle

Run a large language modeling SANDbox in your Local Environment
Other
7 stars 1 forks source link

Optionally use bnb-int8 algorithm. #70

Closed ccmaymay closed 1 year ago