-
## Budget Management
- [x] Add testing for `proxy_server.track_cost_callback` - writing to SpendLogs Table https://github.com/BerriAI/litellm/issues/1584
- [x] Allow Users to Set Budgets per user…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and [discussions](https://github.com/ultralytics/ultralytics/discussions) and fou…
-
As we have to train a custom object detection model on the edge that should run fully on CPU on a Raspberry Pi 4 microboard, I am considering fine-tuning a custom YOLOv8 model optimized with DeepSpars…
-
The [MLCommons taskforce on automation and reproducibility](https://github.com/mlcommons/ck/blob/master/docs/taskforce.md) is helping the community, vendors and submitters check if it is possible to r…
-
**Describe the bug**
Error converting mistral to onnx
**Expected behavior**
```
!pip install virtualenv
!virtualenv myenv
!source /content/myenv/bin/activate
!git clone https://github.com/n…
-
I am trying to run
```
from deepsparse import TextGeneration
pipeline = TextGeneration(model="/mnt/d/mpt-7b-dolly_mpt_pretrain-pruned50_quantized/deployment")
prompt="""
Below is an instruct…
-
**Describe the bug**
Can not server Qwen2-72b.W8A16 compressed model with vllm server
**Expected behavior**
The model can be served in vllm server.
**Environment**
Include all relevant enviro…
-
Hi,
I wanted to try out the Llama2 model that you recently published, but I can't get it working. I'm using Docker on a Mac M1. So I downloaded the deployment.tar.gz file from this page - https://s…
-
Hello,
I could not find any example on how to use deepsparse for object detection on a video.
Here is the script that I use with a "normal" yolo8 model.
```
import cv2
from ultralytics imp…
-
**Describe the bug**
Running the benchmark on AWS t2.micro instance with or without Docker yields the following error:
> arch.bin: ./src/include/cpu_info/detect_arch_json.hpp:240: std::string cpu_in…