-
After evaluating pretrained RelDN model on Visual Genome dataset we get the following results:
{"danfei_metric": {"sgdet20": 0.03587473726452877, "sgdet50": 0.059597123157443185, "sgdet100": 0.082031…
-
The [docs/what-model-should-i-use.md](https://github.com/autodistill/autodistill/blob/main/docs/what-model-should-i-use.md) documentation [page](https://docs.autodistill.com/what-model-should-i-use/) …
-
### Versions
```
openvino 2024.4.0
torch 2.4.1
nncf 2.13.0
g++ (conda-forge gcc 14.1.0-1) 14.1.0
…
-
Add reference code for `mixtral-8x7b`(https://github.com/mlcommons/inference/tree/master/language/mixtral-8x7b) in `axs`.
To do the following steps:
- add recipe for downloading dataset
- add recip…
-
I installed CM following the guide in https://docs.mlcommons.org/ck/install/ successfully
and then refer to https://docs.mlcommons.org/inference/benchmarks/language/bert/ to run the scripts as belo…
-
As many of you might already be familiar, `tflite_flutter_helper` is a popular helper library, specifically for Image processing while dealing with tflite. This was earlier developer by tensorflow tea…
-
(mlperf) susie.sun@yizhu-R5300-G5:~$ cmr "run mlperf inference generate-run-cmds _submission" --quiet --submitter="MLCommons" --hw_name=default --model=resnet50 --implementation=reference --backend=tf…
-
Hello, I have no idea what I'm doing. I'm trying to run on an ARM64 system, and I get the following errors:
I ran the loadgen install and everything worked fine, running the vision benchmarks, fai…
-
Can you share the details of the following benchmark? Is that an end-to-end benchmark? With A100 40G? Multimer or single chain? (as OpenFold didn't support multimer yet). Any scripts to reproduce the…
-
## Enviornment
* CUDA: 11.6
* Python: 3.8.10
* PyTorch: 1.13.1
* DeepSpeed: 0.8.1
* Transformers: 4.26.1
* Diffusers: 0.13.0
* GPU: T4
## Code
```python
"""
Simple script to benchmar…