one-some / KoboldAI-united

GNU Affero General Public License v3.0
3 stars 2 forks source link

Add trendy models/gen methods #7

Closed one-some closed 1 year ago

one-some commented 1 year ago

thanks to not being restrained by hf nonsense we can probably begin implementing trendy stuff hf doesnt have. for a backend to have full integration in kobold, it needs to support callbacks for viewing and manipulating token logits as they're generated.

some stuff to look into: