-
# Question
Can we get DeepseekV2 supported?
# Code to reproduce
```
from tensorrt_llm import LLM, SamplingParams
prompts = [
"Hello, my name is",
"The president of the United States is",
…
-
### The problem
After upgrading from 2024.8.3 to 2024.9.0, the Brother Printer integration is failing.
Here is the complete traceback:
Traceback (most recent call last):
File "/srv/homeassi…
-
Good afternoon!
I'm trying to get information from some printers using SNMP. I followed the steps in the official documentation, but when I run the code, it always says: "module 'pysnmp.hlapi' has …
-
System Info
GPU： NVIDIA RTX 4090
TensorRT-LLM 0.13
quest 1: How can I use the OpenAPI to perform inference on a TensorRT engine model?
root@docker-desktop:/llm/tensorrt-llm-0.13.0/examples/apps# pyt…
-
- if we cannot connect to the cloud, then the userdata syncgroup shouldn't be created
- The location (and blessing) of the cloud should be able to be specified as an option during initialization.
- We…
-
### System Info
x86_64
Ubuntu20.04
A100x8
TRT-LLM version v0.9.0
### Who can help?
_No response_
### Information
- [X] The official example scripts
- [ ] My own modified scripts
…
-
### System Info
System Information:
CPU architecture: x86_64
CPU/Host memory size: 2.0 TiB
GPU Properties:
GPU name: NVIDIA H100 80GB HBM3
GPU memory size: 80 GB (75016 MiB / 81559…
-
When using the hlapi `nextCmd` or `getCmd`, there is no obvious way of checking of constraints as is possible using `lookupValue=False` in the` pysnmp.entity.rfc3413.oneliner` version.
This can ma…
-
We don't currently support bluetooth in the high-level API.
@asimshankar do you know how we might be able to hook it up?
-
I started on Windows in VSC with WSL environment.
I moved to Linux Debian.
I have tried every single example script and get one error or another,
like the one below, or one like it.
Excepti…