search

foundation-model-stack / fms-extras

Apache License 2.0
20 stars 9 forks source link

added llama3 variants #24

Closed JRosenkranz closed 7 months ago

JRosenkranz commented 7 months ago

Added a llama3 model and speculator variant

JRosenkranz commented 7 months ago

might want to consider more granular variant name since '8b' is for "llama 3" (but leaving the architecture name the same).

Fixed this to llama3.8b, but we may want to consider doing something like this for the rest of the variants in the future. Currently we will assume without llama3 is default llama2