-
Hi, thanks for sharing. I haven't seen any code for the text prompts. Did I miss something or just you haven't release?
thanks!
-
I am still confused how to use the prompt within `Mistral-7b-instruct` if I want to analyze the content of a text, such as summary or categorization of the context.
So in my prompt I have a text and …
-
Thanks for leasing this wonderful work!
I saw the demo shows examples of using point, box as input prompt. Does the demo support text as prompt?
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
I want that the model segments based on an input string, e.g. "red cars".
It seems that this is not yet supported in this implementation.
If I find time, I could try to add this. But I need a star…
-
### Description of the issue
when i try to name a character in a few games, the input text prompt don't move the cursor forward when i press a key on the keyborad.
### Reproduction steps
I record a…
-
import ctranslate2,psutil,os,transformers,time,torch
generator = ctranslate2.Generator("/ct2opt-1.3b",tensor_parallel=True,device="cuda")
tokenizer = transformers.AutoTokenizer.from_pretrained…
-
### Your current environment
vllm version: '0.5.0.post1'
### 🐛 Describe the bug
When I set tensor_parallel_size=1, it works well.
But, if I set tensor_parallel_size>1, below error occurs:
Run…
-
fresh installation (NVIDIA + CUDA 12.1) with one_click_install.bat in llama_index_pq.
If a try chat, i get:
F:\AI\prompt_quill\prompt_quill\llama_index_pq\installer_files\env\Lib\site-packages\trans…
-
### Description
If I edit the prompt and click on another tab, the editing mode will end and the prompt will be Markdown-rendered.
I expect to stay in edit mode, as is the case when I type/edit a …
dandv updated
1 month ago