Larger models available or planned?

ridgerchu / matmulfreellm

Implementation for MatMul-free LM.

Apache License 2.0

2.7k stars 164 forks source link

Larger models available or planned? #33

Open jaggzh opened 2 weeks ago

jaggzh commented 2 weeks ago

Anything larger than 2.7B cooking? I'm itching to test the larger capacity and its scaling against the larger small LLMs of comparable size (or comparable resource use).

ridgerchu commented 2 weeks ago

Hi, sorry that until now we still do not have enough resources to scale up our model... Thanks for your interest!