-
### 🐛 Describe the bug
```
Traceback (most recent call last):
File "/home/default/driver state detection/Fabian/facial landmarks/STAR/demo_CH.py", line 302, in
onnx.checker.check_model(mode…
-
- [ ] [Announcing Together Inference Engine 2.0 with new Turbo and Lite endpoints](https://www.together.ai/blog/together-inference-engine-2)
# Announcing Together Inference Engine 2.0 with new Turbo …
-
Notice: In order to resolve issues more efficiently, please raise issue following the template.
(注意:为了更加高效率解决您遇到的问题,请按照模板提问,补充细节)
## 🐛 Bug
### To Reproduce
Steps to reproduce the behavio…
-
In my inference setup, I used build.sh to build my llama-based model (without any quantization and tp=8).
In tensorrtllm inference, I used run.py provided by tensorrtllm repo [https://github.com/NV…
-
### Description
When trying to process sct_run_batch following instructions on sct website, it works, but only for for the sample data. When those instructions are applied to a "real world" dataset…
-
### 问题确认 Search before asking
- [X] 我已经查询[历史issue](https://github.com/PaddlePaddle/PaddleDetection/issues),没有发现相似的bug。I have searched the [issues](https://github.com/PaddlePaddle/PaddleDetection/issu…
-
Its a really good model for its size and it aligns with the goal of this project.
-
Hello,
I am trying to write a bare minimum batched inference script and it turns out that pred2coords() function is not compatible with batches. Is this the expected behaviour?
-
When deploying this template, using a model registry with an approved model, the deployed SageMaker Pipeline does not contain the name of the SageMaker Model to use for the Batch inference.
The pr…
-
### Prerequisite
- [X] I have searched [Issues](https://github.com/open-mmlab/mmcv/issues) and [Discussions](https://github.com/open-mmlab/mmcv/discussions) but cannot get the expected help.
- [X]…