LLM should decide which API to select based on the user query once the API is selected LLM should send request with required parameters to API( this will reduce the payload) and get the data. Once the data is fetched it should be synthesized in order to answer the user query in natural language.
Reason
Majorly i have two reasons,
Interest in Future Developments: Curious about any planned enhancements in Llama-index for direct API integration to improve efficiency and data accuracy.
Request for Guidance: Seeking insights or solutions for integrating external APIs with Llama-index.
Value of Feature
If any organisation is'nt comfortable to connect entire database with llamaindex, then that organisation will create some APIs from the database then use these APIs to connect with llamaindex.
Feature Description
LLM should decide which API to select based on the user query once the API is selected LLM should send request with required parameters to API( this will reduce the payload) and get the data. Once the data is fetched it should be synthesized in order to answer the user query in natural language.
Reason
Majorly i have two reasons,
Interest in Future Developments: Curious about any planned enhancements in Llama-index for direct API integration to improve efficiency and data accuracy.
Request for Guidance: Seeking insights or solutions for integrating external APIs with Llama-index.
Value of Feature
If any organisation is'nt comfortable to connect entire database with llamaindex, then that organisation will create some APIs from the database then use these APIs to connect with llamaindex.