-
Exception in thread Thread-4:
Traceback (most recent call last):
File "/root/anaconda3/envs/cosyvoice/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "/root/anac…
-
### Checklist
- [ ] The issue exists after disabling all extensions
- [ ] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
Hi,
I'm following the [Chat index examples](https://python.langchain.com/en/latest/modules/chains/index_examples/chat_vector_db.html) and was surprised that the history is not a Memory object but …
da-bu updated
2 weeks ago
-
### What behavior of the library made you think about the improvement?
I have just started to use Outlines, and my use case is that I am hosting a local model on a server using [Serve with vLLM](http…
-
The generator prompts you to answer some questions that I think are a bit unclear to answer to someone just setting up a new bundle. For example, "Is this a "single instance" graphic?" -- without any …
-
### 🐛 Describe the bug
**Using `LazyInitContext` and later loading checkpoint do not properly initialize model parameters.**
```python
import colossalai
from colossalai.lazy import LazyInitCon…
-
### The problem you are trying to solve:
Streaming flow results eliminates dead time of users waiting around. I know it's not possible for intermediate flow steps, but the final one could be streamed…
-
There seems to be no place to type near, under or anywhere near the Shot Generator panel on my screen. See attached, please.
 application using Hayhooks and the Haystack framework. I have two pipelines: `postgres_indexing` and `p…
-
### What happened?
We expected to see similar performance in llama.cpp when compared to ipex-llm. But llama.cpp was almost two times slower than ipex-llm given all the parameters were the same.
…