-
I want to have longer conversations with the model, but as I understand, the number of tokens in the prompt message + the number of tokens generated by the model should be less than the context size (…
-
This thread is dedicated to discussing the setup of the webui on AMD GPUs.
You are welcome to ask questions as well as share your experiences, tips, and insights to make the process easier for all…
-
I see from the code repo that we are using OpenAI APIs, how can we make this work for Open source models like Llama2?
can someone give me detail on this and what steps I need to follow?
-
Setup Local GenAI for @payobills https://github.com/payobills/payobills/issues/119
-
If using OpenAI is too expensive for you to try out examples with long text, you can create a free API key in seconds at https://console.groq.com/keys using your gmail or github then make the changes …
-
**Is your feature request related to a problem? Please describe.**
Currently we only support `retrieve_online_documents`. We should add a way to allow for vector search for historical retrieval so us…
-
### Description
Is a chance to add integration with other AI models, maybe some open source which allow to create own serwer?
### Suggested Solution
llama
### Alternatives
_No response_
### Addi…
-
### What is the issue?
Many models, in particular codegemma 1.1 7b q8_0, don't load for various reasons on versions after 0.1.132. Works fine on 132. I don't have the logs on hand at the moment, but …
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related iss…
-
Hi, just wanted to say thank you for creating this project! I am testing out building a simple application - identical to your example, but setting the crate type as a lib using wasm-pack. And I get t…