-
Is a performance benchmark of DirectML on Intel available? I ran a quick perf experiment [[notebook](https://github.com/mmaitre314/ONNX-DirectML/blob/main/notebook.ipynb)] with ResNet inference using …
-
WIth the increasing number of benchmarks and checks, we have found several issues with the submission checker (https://github.com/mlcommons/inference/blob/master/tools/submission/submission_checker.py…
-
Hi
I'm trying to use dMaSIF for interaction prediction between proteins (taking a target and finding the best binder in a large collection of potential binders)
At the moment, I process both bin…
-
Hi, thank you for making this great work!
I'd like to know
If the denoising methods' evaluation method uses the model trained with denoised IMAGESET2 (not with IMAGESET1), is the performance still…
-
## 🐛 Bug
I successfully exported roi_head module but failed to load model.
## To Reproduce
```python
import torch
import io
import unittest
from maskrcnn_benchmark.structures.image_list…
-
@mukel thank you for creating this project! I would like to discuss the following topics:
1. Please enable the Discussions tab for posts like this, which are not real "issues"
2. Do you plan on rele…
-
## Description
- There is an MXNet nightly benchmark which runs CV and NLP models on MXNet Nightly pip wheel and report the metrics and it showed a performance regression on GPU Memory.
- After bise…
-
https://hud.pytorch.org/benchmark/compilers?startTime=Mon%2C%2024%20Jul%202023%2003%3A44%3A56%20GMT&stopTime=Mon%2C%2007%20Aug%202023%2003%3A44%3A56%20GMT&granularity=hour&suite=timm_models&mode=infer…
-
We currently only use Detectron2's `DefaultPredictor` for inference:
https://github.com/bertsky/ocrd_detectron2/blob/0272d95a930d5136bba29e530a3530c13ab17166/ocrd_detectron2/segment.py#L126
But th…
-
Recently, a lot of benchmarks point to the fact that if you want to serve your models behind an API, continuous batching grants higher throughput and lower latency compared to static batching. Some ex…