-
- see also https://github.com/ObrienlabsDev/blog/issues/47
- see https://github.com/ObrienlabsDev/rag/issues/4
-
/kind feature
**Describe the solution you'd like**
Hope add [https://github.com/xorbitsai/inference](https://github.com/xorbitsai/inference) as the kserve huggingface LLMs serving runtime
Xor…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
First of all thank you very much for open sourcing this project and maid. Would you provide documentation on how to integrate with any Flutter or dart application? Related to https://github.com/davidm…
-
### What features would you like to see added?
Open-source alternative to Assistants API, as a successor to the "Plugins" endpoint, with support for Mistral, AWS Bedrock, Anthropic, OpenAI, Azure O…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
With the ipex-llm docker container,
intelanalytics/ipex-llm-serving-vllm-xpu-experiment:2.1.0b2
it successfully load model in 4 ARC. But when load model in 8 ARC, it will have the following error…
-
### Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
Yes
### OS Platform and Distribution
iOS 15
### MediaPipe Tasks SDK version
0.10.14
…
-
### win11专业版下安装wsl2,wsl下安装docker desktop,在镜像中运行pytorch代码报错
启动镜像命令
```
docker run -itd --privileged --device=/dev/dri -v /c//models:/llm/models -v /usr/lib/wsl:/usr/lib/wsl --name=arc_vllm --s…
-
### What happened?
```10:32 akara@nneka /Users/akara/currentporoject/llama.cpp
% sw_vers
ProductName: macOS
ProductVersion: 14.6
BuildVersion: 23G80
10:43 akara@nneka /Users/akara/current…