Grok is actually llama!

openai / grok

MIT License

4.06k stars 506 forks source link

Grok is actually llama! #13

Closed seshubonam closed 3 months ago

seshubonam commented 3 months ago

I've always wondered least amount of work went into grok.

Just a finetune of llama 7bn model

what say

RahulBhalley commented 3 months ago

Maybe Mistral now. Seems Zephyr is a fine-tune of Mistral 7b. Llama 7b is now kinda obsolete in comparison to these. Just guessing based on testing but I really don't know much about LLMs in depth.