-
Thank you for your wonderful work! But I have a little confusion about the training speed.
In the paper, it said 4 hours + 1.5 hours on RTX4090. However, I test the compressor scene on RTX A6000. F…
-
Currently, it's ~70%. We could try using a bigger batch but it also depends on language.
[GCP console for translate-mono task](https://console.cloud.google.com/monitoring/dashboards/builder/a6c8749…
-
When I enable the "Optimize game latency", my FPS drops, and GPU utilization decreases.
When I disable "Optimize game latency," FPS is stable, and GPU utilization increases, but the latency become…
-
**Describe the bug**
I tried to use the GEOPM Runtime to monitor a simple microkernel that leverages the GPUs and I expected all the fields I added to the report via ```GEOPM_REPORT_SIGNALS``` to pro…
-
### Anything you want to discuss about vllm.
I run the model on the server with 4 x NVIDIA GeForce RTX 4090 cards:
CUDA_VISIBLE_DEVICES=4,5,6,7 python -m vllm.entrypoints.openai.api_server --served…
-
I'm having trouble interpreting some of the results...
After an Automatic Brute Search analysis, when I analyse the result_summary, I look at the Avegrage GPU Utilization.
How is this value de…
-
### 🚀 The feature, motivation and pitch
I'm struggling to figure out how to extend our test suite to include vllm tests. The problem is that by default vllm will take over the whole gpu, which prev…
-
I just followed the tutorial to run the example code, but the model was running with less than 10% GPU usage. Why is this happening and can it be improved?
-
I use this command to run docker `docker run --rm --gpus '"device=1"' --init --ulimit core=0 -p 8070:8070 -p 8081:8071 grobid/grobid:0.8.0` and then the GPU RAM consumed 20+ GB. But I found that and …
-
### 🐛 What's Going Wrong?
> In the OpenLIT Dashboard GPU monitoring screen, the "Avg Utilization Percentage (%)" and "Fan Speed (0-100)" fields do not display any output values.
### 🕵️ Steps to R…