Does AgentStudio allow different functions to be used depending on the input prompt?

dusty-nv / NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

https://dusty-nv.github.io/NanoLLM/

MIT License

197 stars 32 forks source link

Does AgentStudio allow different functions to be used depending on the input prompt? #46

Open shifsa opened 2 months ago

shifsa commented 2 months ago

Hello, I have a question about the AgentStudio feature: does it have a function to use different tools depending on the input prompt, similar to the Agent feature in LangChain?

dusty-nv commented 2 months ago

Hi @shifsa, it can load function-calling LLM that can call different tools. I have limited manual routing in place but you can quickly add a plugin for your desired search patterns.