-
### Your current environment
```
Collecting environment information...
WARNING 10-16 15:01:13 cuda.py:76] Detected different devices in the system:
WARNING 10-16 15:01:13 cuda.py:76] NVIDIA A100…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Environment
```markdown
- Milvus version:
master branch (2.4.12+, 3936d126614de6cefe52b9d061ef4007cd94…
-
2024-09-25T03:12:13.473Z info: [inference][15] Starting an inference job for bookmark with id "z3nf9s85x282vcvf42pp7v9u"
2024-09-25T03:12:14.911Z info: [inference][15] Starting an inference job for b…
-
### System Info / 系統信息
```ruby
Package Version
------------------------ -----------
accelerate 1.1.1
aiofiles 23.2.1
aiohappyeyeballs 2.4.3…
-
Right now if the underlying model is re-deploying, the widget just looks broken / unresponsive
The network call does end up in a 503 though - we should display an error message
:
File "/home/orangepi/.local/lib/python3.10/site-packages/rknnlite/api/rknn_lite.py",…
-
Hello! First of all, great job with this inference engine! Thanks a lot for your work!
Here's my issue: I have run vllm with both a mistral instruct model and it's AWQ quantized version. I've quant…
-
### Describe the bug
I have set up a basic HF Space from an AutoTrain object detection model. The model is based on `facebook/detr-resnet-101`. The space builds and loads properly, but when i submit …
-
### Description
Right now, SDK implementers creating Boosts with EventActions accept a non-zero amount of cognitive load and guesswork to build a correct ActionStep, including:
1. Figuring out t…
-
### System Info
GPU: A100
Python:3.10.13
### Information
- [ ] Docker
- [ ] The CLI directly
### Tasks
- [ ] An officially supported command
- [ ] My own modifications
### Reproduction
`cargo …