-
-
It will be useful to be able to specify load in other ways, not just users.
At least in the environment I am in we look at response times always with respect to req/s coming to the system. Something …
-
### Do you need to file an issue?
- [X] I have searched the existing issues and this bug is not already filed.
- [ ] My model is hosted on OpenAI or Azure. If not, please look at the "model providers…
-
### Context
We're building new endpoints as part of #248, and discussing this in places like https://github.com/Police-Data-Accessibility-Project/data-sources-app/issues/345
### Requirements
…
-
I'm pulling comment from @helje5 from #28 over into this issue, because that issue is getting cluttered.
> The worse aspect is that this calls the done-cb before the queued write has actually finis…
-
### Describe the bug
When using AzureOpenAI llm and embeddings, local search generates the error:
`AttributeError: 'AzureOpenAIEmbeddings' object has no attribute 'embed'`
### Steps to reproduc…
-
Description: I recently switched from using fbonalair/traefik-crowdsec-bouncer to this project as it was more updated, and seemed to more customisable. However, I tried to ban my own IP but that did n…
-
**What I tried:**
I ran this on my local GPU and and tried replacing the api_base to a model served on ollama in settings.yaml file.
model: llama3:latest
api_base: http://localhost:11434/v1 #ht…
-
感謝你的教程，在建立knowledge graph時候我知道他會花費很多時間，但是我發現他會在執行過程中發生瓶頸，電腦的CPU和GPU幾乎沒有甚麼在運作，請問這是正常的嗎? 有甚麼方法可以改善效率呢?
前提致謝!
圖片中的執行時間是我已經中斷後重新執行
算法，水(请求)先进入到漏桶里，漏桶以一定的速度出水(接口有响应速率)，当流入速度过大时，会直接溢出(访问频率超过接口响应速率)，然后就拒绝请求，而当入小于出的情况下，漏桶不起任何作用。可以看出漏桶算法能强行限制数据的传输速率。示意图如下:
[![image](https://user-images.githubu…