-
Each benchmark should have `"metadata.details.solver"` as the solver's name (or names) that can be used to test against this benchmark.
-
why this datasets have both vis and lang datasets ,and the vis datasets are without language annotations .
I am curious about the benchmark results are trained and tested on what dataset
-
Hi,
Thank you for the benchmarking work of putting most of the existing methods together and providing a quantitative comparison of performances.
When I took a closer look at the 32 simulated spati…
-
In the paper, you said that you first pre-train the baseline model with classification loss, regression loss, and adversarial loss (step 2 in the repo). And your model is based on the pretrained Regio…
-
During a routine test h2oautoml installed successfully but failed to pass the test benchmark.
id,task,framework,constraint,fold,type,result,metric,mode,version,params,app_version,utc,duration,training…
-
## ❓ Questions and Help
When I execute python3 tools/test_net.py --config-file configs/e2e_mask_rcnn_R_101_FPN_1x.yaml
Traceback (most recent call last):
File "tools/test_net.py", line 114…
-
## Habitat-Lab and Habitat-Sim versions
Habitat-Lab: 0.3.1
Habitat-Sim: 0.3.1
## 🐛 Bug
## Steps to Reproduce
Steps to reproduce the behavior:
1. https://aihabitat.org/docs/habita…
-
https://github.com/mlcommons/training_policies/blob/master/training_rules.adoc#14-appendix-benchmark-specific-rules
Here, it is stated that feature caching is not allowed. What is the definition of…
-
I'm running the baseline on the single video (default is SNGS-021), and after the visualization video is created and when tracking is done, an error occurs, saying that the GT file cannot be found.
…
-
Hello, congratulations on completing such solid work! Will the Benchmark Dataset be open-sourced? Also, is there a rough timeline available? Also, is there a timeline available?