-
文件地址 https://github.com/QwenLM/Qwen-Agent/blob/main/examples/qwen2vl_function_calling.py
Qwen-Agent 是git clone 本地安装的 时间20240909
使用 https://hub.docker.com/r/qwenllm/qwenvl vllm运行的 7b-int4 model
# …
-
### OS
Linux
### GPU Library
CUDA 12.x
### Python version
3.12
### Describe the bug
If you start the server without a model, or unload the model first before stopping the server, it will throw …
-
Issue: there are many examples and is getting harder to know what they are about just from the example name
My recommendation would be to:
1)group examples into bucket folders
2)add a left column…
-
### System Info
- CPU architecture : x86_64
- CPU/Host memory size : 32 GB
- GPU name L4 at g2-standard-8 (GCP)
- GPU memory size 24GB
- TensorRT-LLM branch or tag (e.g., main, v0.10.0)
- Nvi…
-
For example for this image
![5bdf3ed8-d35e-4e6d-a09c-45e467b16118](https://github.com/user-attachments/assets/8c5b9d9a-e98f-4fd6-a05c-c05d66bb7fc0)
is this a good prompt?
```
Dragon awakens …
-
### System Info
- CPU architecture: x86_64
- Host memory: 256GB
- GPU
+ Name: NVIDIA A30
+ Memory: 24GB
- Libraries
+ TensorRT-LLM: v0.11.0
+ TensorRT: 10.1.0
+ CUDA: 12.6
+ NVID…
-
## User Story
- As a content consumer, content manager, and SEO manager
- I am accustomed to the base URL for blog posts to include `/blog/`
- Which signals to me and search engines such as Google tha…
-
Hi experts,
I'm running a 1.3B model on windows with 16GB V100 with below envs, but hit an issue which I couldn't find any clue. Could you please help check it.
TensorRT-LLM version: tag v0.10.0…
ljayx updated
2 months ago
-
**Title of the talk/workshop**
Building a RAG App with Groq (Llama-3), Hugging Face opensource model and Llama-Index: A Love-Hate Story
**Abstract of the talk/workshop**
How to build a RAG ap…
-
ESG, Oil & Gas, Infra Verordnungen usw usw.
Pretty much all of this:
https://origocloud.srvhost.de/apps/files/files?dir=/Shared/echovue.ai%20Team/Library%20Input/to%20be%20uploaded
needs to be rewr…