search

PygmalionAI / aphrodite-engine

Large-scale LLM inference engine
https://aphrodite.pygmalion.chat
GNU Affero General Public License v3.0
1.09k stars 120 forks source link

[Feature]: Support [RecurrentGemmaForCausalLM] #506

Open sung-ho-moon opened 4 months ago

sung-ho-moon commented 4 months ago

🚀 The feature, motivation and pitch

I want use recurrentGemma in aphrodite-engine

ValueError: Model architectures ['RecurrentGemmaForCausalLM'] are not supported for now.

Alternatives

No response

Additional context

No response

AlpinDale commented 4 months ago

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

sung-ho-moon commented 4 months ago

It's definitely planned. I haven't looked at the architecture yet, but I assume it's RNN-based, so #419 would probably make ways for it.

We have a lot more to work on at the moment, so this may take a while.

Thank you. Take care of yourself.

AlpinDale commented 4 months ago

Please keep the issue open for tracking purposes.