Where do you get the LLM model?

tleers / llm-api-starterkit

Beginner-friendly repository for launching your first LLM API with Python, LangChain and FastAPI, using local models or the OpenAI API.

https://blog.timleers.com/a-stupidly-minimal-llm-api-starterkit-deploy-llm-endpoints-in-a-minute-with-langchain-and-fastapi

95 stars 11 forks source link

Where do you get the LLM model? #1

Closed aladinoster closed 1 year ago

aladinoster commented 1 year ago

👋🏼 Interesting blog!

Thanks for the post, small question where do you get this binary file?

https://github.com/tleers/llm-api-starterkit/blob/18cd7b207752f6ca6b189dd8f805c3c7ba79c985/app/main_local_gpt_4_all.py#L15

tleers commented 1 year ago

Glad you liked it! If you surf to gpt4all and scroll down the main page, you'll find a drop-down with a list of models and an explanation, as well as a download button.

aladinoster commented 1 year ago

Thanks a lot!