search

marcusschiesser / unc

Enterprise-ready, privacy-first ChatGPT platform
https://unc.de
GNU Affero General Public License v3.0
7 stars 1 forks source link

[Refactor] Consider using Vercel AI #15

Closed marcusschiesser closed 8 months ago

marcusschiesser commented 11 months ago

see https://sdk.vercel.ai/

Next step: Analyze advantages and (disadvantages)

LaDoger commented 11 months ago

@marcusschiesser What's so amazing about Vercel?

marcusschiesser commented 10 months ago

From a quick analysis, we could greatly simplify the code in https://github.com/marcusschiesser/unc/blob/6c378cb9ac40212b9cad2b82312da8827601a785/app/client/platforms/llm/openai.ts - but this doesn't have a big priority

marcusschiesser commented 8 months ago

https://github.com/marcusschiesser/unc-llamaindex is not using it on purpose (as we need to stream JSONs)