-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
```
def Node_Sentence_Window():
node_parser = SentenceWindowNodeParser.from_de…
-
Hello,
As more people jump on board with using and developing Qwen's open-source models, we've seen a bunch of variants popping up. I think it'd be really cool if this project could support them. …
-
[StartApp_log.txt](https://github.com/TumblerWarren/Virtual_Avatar_ChatBot/files/13774037/StartApp_log.txt)
From Log I can see that it has some issues with ELEVENLABS but VOICEVOX is selected.
`…
oivio updated
10 months ago
-
### Summary
The `run-llm.sh` command is a tool that helps developers get started quickly. I believe we should only support the latest versions of these models. We will provide the full model list o…
-
I noticed that sometimes, DataCollatorForCompletionOnlyLM does not recognize a response template within a given prompt. In particular, this occurs whenever the tokenizer tokenizes symbols at the end o…
-
I am running AMD 6800U on my Ubuntu 22.04 and I installed the AMD driver. I checked that the default system would allocate 512MB RAM to VRAM to the GPU.
I followed [some instruction](https://github…
-
In the new vllm 0.3 release mixtral with gptq does not generate any output anymore. Loading the model works fine, when calling the `llm.generate` it gets stuck.
```
from vllm import SamplingPar…
-
model : Llama 3.2 1B (without any quantization)
I ran the app, loaded the model, and entered the input, but the following error appears in the middle of the output.
```shell
2024-10-16 17:11:17.7…
-
From: https://twitter.com/K_Sakanoshita/status/1699200323779461160
ja (Original):
> [@yuiseki_](https://twitter.com/yuiseki_)
これの日本語版が欲しいけど、相談に乗ってくれそうな方ってご存知でしょうかー。 [https://mappers.un.org/learn…
-
https://github.com/Sosuke115/qlora_ja/pull/2/files