openai-base path updates

artificialcitizens / acai.so

Your AI Powered Toolkit

https://acai.so

Other

14 stars 2 forks source link

openai-base path updates #57

Closed mabry1985 closed 1 year ago

vercel[bot] commented 1 year ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
acai-so	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Oct 8, 2023 6:53pm

mabry1985 commented 1 year ago

A few regressions/bugs here from initial testing:

Chat no longer has streaming replies
Knowledge upload not working atm, no errors
autocomplete seems to be okay for the most part, but I see the chat models often include the initial words. This is a problem I've definitly ran into before and why the instruct models seem better for these tasks imo

Screenshot 2023-10-07 at 1 12 22 PM

mabry1985 commented 1 year ago

@bioshazard a couple regressions that I def want to figure out before merging your work, but overall it will be a solid addition to the codebase

mabry1985 commented 1 year ago

@bioshazard I think the main thing I would like to sort out before merge is the embeddings. I'll take a pass at it this week

bioshazard commented 1 year ago

I did attempt it here and had a working kb ingest:

https://github.com/artificialcitizens/acai.so/pull/57/commits/e4ec23551b1dbf3450dade9bd99f60833769e2d3

Tho I think it might be nice to loop through the docs rather than bulk embed for local LLM. Locks it up till it finishes.

bioshazard commented 1 year ago

Might have regressed openai embed tho yea dang. Might be worth undoing the embed too get it in then trying for local embed again another pr if it gives too much trouble

mabry1985 commented 1 year ago

@bioshazard good news! It seems like false alarms on the embeddings and the streaming chat 🎉 They are both working today apparently. Gonna run some more tests to make sure