Can a RestAPI be built - Githubissues

tairov / llama2.mojo

Inference Llama 2 in one file of pure 🔥

https://www.modular.com/blog/community-spotlight-how-i-built-llama2-by-aydyn-tairov

MIT License

2.09k stars 140 forks source link

Can a RestAPI be built #17

Closed StudyingLover closed 12 months ago

StudyingLover commented 1 year ago

The fast llama2 reasoning is really helpful to us, but how to add a RestAPI to mojo, preferably one that is compatible with the openai interface? I don't know much about mojo. I know how to use python flask. Can you help me?

hungtooc commented 1 year ago

I have the same issue

tairov commented 1 year ago

I haven't researched this topic. I can suggest to look for something similar but for llama2.c