search

soilwise-he / natural-language-querying

Application component that provides Natural Language Querying (NLQ) services, making knowledge stored in a graph database accessible for e.g. a ChatBot UI.
MIT License
0 stars 0 forks source link

Discuss which type of LLM to be used and where it will be hosted #3

Open robknapen opened 2 months ago

robknapen commented 2 months ago

Various LLMs exist, e.g. different in size (number of parameters), open or closed, locally installed or hosted by a company, and so on. It is good to know some initial preferences by the project.

robknapen commented 2 months ago

Not that using an LLM requires access to one (or more) GPUs, depending on the size of model selected.

robknapen commented 1 month ago

To avoid installation complexity (figuring out access to GPU resources), in the first prototype we might make use of our WEnR OpenAI subscription and later declare costs to the project.