h2oai / h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/
http://h2o.ai
Apache License 2.0
10.95k stars 1.2k forks source link

Does h2o have assistant API #1660

Open cpgames opened 1 month ago

cpgames commented 1 month ago

Something like this: https://platform.openai.com/docs/assistants/overview

I am specifically interested in tool/function calling.

pseudotensor commented 1 month ago

I'm waiting for this to be merged:

https://github.com/vllm-project/vllm/pull/5032/files

at least in order to support function calling more generally in h2oGPT.

Later PRs are not required but would be useful: https://github.com/vllm-project/vllm/issues/1869