steven-tey / novel

Notion-style WYSIWYG editor with AI-powered autocompletion.
https://novel.sh
Apache License 2.0
12.47k stars 1.03k forks source link

feat: Recommend updating package's model to GPT-4o-mini #433

Open BintzGavin opened 1 month ago

BintzGavin commented 1 month ago

Describe the feature you'd like to request

I'd like to recommend that this package update its current language model from GPT-3.5-turbo to the newer GPT-4o-mini.

Describe the solution you'd like to see

Updating the model to GPT-4o-mini would provide several benefits:

Additional information

No response

alexanderbnelson commented 3 weeks ago

Can't you just use whatever model you want at your api route handler?

 const response = await streamText({
    model: openai.chat("gpt-4o-mini"),
  });

  return response.toTextStreamResponse();
BintzGavin commented 3 weeks ago

Yeah, exactly:

https://github.com/steven-tey/novel/pull/434/files

2-fly-4-ai commented 3 weeks ago

how do I get the AI autocomplete functionality? The demo version doesn't seem to have it. What am I missing?