google / gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.
Apache License 2.0
5.94k stars 502 forks source link

RecurrentGemma 9b support #252

Open fizzAI opened 3 months ago

fizzAI commented 3 months ago

Hi! Are there currently any plans to support the 9b version of RecurrentGemma that recently released?

pculliton commented 3 months ago

Hi! We do have plans to support RecurrentGemma 9b. There is some internal work to be done - I think it's likely that we'll be able to release it around the end of June. If contributors want to help, we could definitely use help with:

This would save us some time in launching it! Thanks for raising this issue.