search

PygmalionAI / aphrodite-engine

PygmalionAI's large-scale inference engine
https://pygmalion.chat
GNU Affero General Public License v3.0
606 stars 78 forks source link

[WIP] feat: Mamba support #419

Closed AlpinDale closed 5 days ago

AlpinDale commented 1 month ago

Support for mamba, including the hybrid architectures jamba and zamba.

AlpinDale commented 1 month ago

It works, but it seems to produce slightly coherent text. Needs to be investigated.