Integrate/Refactor to use Chat Completion API

CloudLLM-ai / cloudllm

CloudLLM is a Rust library designed to seamlessly bridge applications with remote Language Learning Models (LLMs) across various platforms.

MIT License

5 stars 1 forks source link

Open gubatron opened 3 months ago

gubatron commented 3 months ago

This api should enable considerable token savings since I believe now you don't need to send back the entire conversation every time https://platform.openai.com/docs/api-reference/chat/object