OpenAgentsInc / workerbee

GPUtopia worker process for client machine
GNU Affero General Public License v3.0
18 stars 8 forks source link

support any pytorch in f16 #5

Closed earonesty closed 1 year ago

earonesty commented 1 year ago

support any pytorch

make streaming more consistent

update to new llama cpp