-
### Your current environment
PyTorch version: 2.4.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC version: (U…
-
previous context: #431 #306 #374
/bounty 200
@EzraEllette
ideally this solves:
- new features: ability to stream audio in integrations like pipes, apps on top of screenpipe, voice agents, …
-
- [x] [募集サイト](https://devblog.connpass.com/event/322591/) をconnpassに作る
- [x] URLを貼る
- [x] 放送開始
-
### Your current environment
vllm version:
```
e9de9dd551ac595a9f3825fcd1507deceef4f332
```
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA use…
-
### Model description
Hi all,
currently, the microsoft/Phi-3-mini-128k-instruct is not supported by text-generation-inference. As displayed in the following error:
```
2024-04-25T12:45:45.28…
-
This issue contains the test results for the upstream sync, develop PR, and release testing branches. Comment 'proceed with rebase' to approve. Close when maintenance is complete or there will be prob…
-
This issue contains the test results for the upstream sync, develop PR, and release testing branches. Comment 'proceed with rebase' to approve. Close when maintenance is complete or there will be prob…
-
This issue contains the test results for the upstream sync, develop PR, and release testing branches. Comment 'proceed with rebase' to approve. Close when maintenance is complete or there will be prob…
-
Continued in #2590
-
This issue contains the test results for the upstream sync, develop PR, and release testing branches. Comment 'proceed with rebase' to approve. Close when maintenance is complete or there will be prob…