Closed oatmealm closed 4 months ago
I tested it with an openai compatible provider and it seems to work. Embedding still done via ollama. So something about the above setup is not working with ollama.
Thanks for the report, I'll look into this soon.
I wasn't able to reproduce exactly your problem, but I did reproduce a problem, which is fixed with https://github.com/ahyatt/llm/pull/54. I haven't made this into an llm
release yet, but can you verify (or not) the fix?
@oatmealm I think you confirmed in https://github.com/ahyatt/ekg/discussions/150#discussioncomment-10165834 that this is working for you now, so I will close this and release a new version of llm
soon.
Sorry commented on the other issue. Yes. Seems to work. Thanks.
1stly, wow. ekg is exactly what I didn't know I needed :) really love the modularity and considered design, and integration with llm in this particular way seems very intentional and useful. Thank you for writing this package!
This seem to happen when calling
ekg-llm-query-with-notes
:Embedding generation with this provider seem to work...
the notes are very short.
Trace: