-
### Have I written custom code (as opposed to using a stock example script provided in MediaPipe)
None
### OS Platform and Distribution
Google Colab (Linux) Ubuntu 22.04.3 LTS
### MediaPipe Tasks …
-
### What is the issue?
I updated to llama3, I use the SubtitleEdit program to transcribe other languages, the program translates correctly, but when I want to transcribe from English to Spanish it …
-
# Problem
I have encountered many issues with the wrong model default settings (incorrect prompt template, the stop words missing, etc.).
e.g., comments in Jan 0.5.7 Release Sign Off janhq/jan#3818…
-
I follow the instruction and can run Mistral with llama on GPU A100 or A5500
but I don't know how to set tp_size=2 / workers=2 to get the convert_checkpoint config
I try 2 GPUs on 1 device or 2 devi…
thj08 updated
6 months ago
-
qwen# python convert_checkpoint.py --model_dir /code/tensorrt-llm/Qwen1.5-32B-Chat/ --output_dir ./trt_ckpt/qwen1.5-32b/fp16 --dtype float16 --tp_size 4
[TensorRT-LLM] TensorRT-LLM version: 0.11.0.de…
-
My ComfyUI is not the portable. I installed the Searge LLM with the ComfyUI manager, then I installed it manually, in both cases; I got the Traceback below error. I tried to Install the following comm…
-
# Prerequisites
Please answer the following questions for yourself before submitting an issue.
- [yes] I am running the latest code. Development is very rapid so there are no tagged versions as …
kmlob updated
9 hours ago
-
-
Traceback is as followed, I was running ChatGLM4-9b-chat on my laptop.
Device configurations
OS: Win 11 23H2 (22631.3737)
- CPU: i7-1260P
- GPU: 'Intel(R) Iris(R) Xe Graphics', platform_name='Inte…
-
**Is your feature request related to a problem? Please describe.**
**Describe the solution you'd like**
Today KAITO supports the popular huggingface runtime. We should support other runtime like…