How can i inference in C ？ - Githubissues

meta-llama / llama

Inference code for Llama models

Other

54.12k stars 9.32k forks source link

How can i inference in C ？ #1101

Open toutouya opened 2 months ago

toutouya commented 2 months ago

How can i inference in C ？

koiava commented 4 weeks ago

Check out laama2.c repo. It has minimalistic implementation with no dependencies. https://github.com/karpathy/llama2.c/tree/master