search

MDGrey33 / Nur

The self actualizing documentation framework that heals its knowledge gaps as naturally as a ray of light. Check http://NurMind.com for updates and the discord invite to engage with us.
Apache License 2.0
17 stars 3 forks source link

Allow Nur to decide which model to use based on size of relevant context #11

Closed MDGrey33 closed 8 months ago

MDGrey33 commented 8 months ago

In an attempt to reducing operational cost, I will attempt to implement the following:

  1. including proximity in the context retrieval
  2. limit context beyond that proximity
  3. Based on the size of relevant context use 4 turbo or the new extended context 3.5 Turbo
MDGrey33 commented 8 months ago

3.5 turbo with extended context is unusable, slow and low quality output