search

randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
833 stars 118 forks source link

Question - perform tasks #25

Closed kmichal closed 1 year ago

kmichal commented 1 year ago

Hi,

Would anyone would be able to tell me whether it is possible to have this kind of model perform a task like calling an API and how would one do it?

randaller commented 1 year ago

@kmichal All LLM models does only the one task - returning next most likely token to be. Even GPT4. API calls performed by wraparound code, for example, you may analyze a user question to model using another NLP model, then perform any actions you wish, calling any API, for example, and then one might with to put both API call result data and user query as context to LLM, so it will get more context and will be able to return best tokens.