-
This is a master issue to track all items related to the November 1st MultiNet Release. The motivation & scoping for this release is below. We follow w/ the specific issues being tracked with specific…
-
Thank you very much for your work. I encountered an issue and would like to ask for your assistance. I trained using the configuration file SGG-Benchmark-main/configs/VG150/e2e_relation_yolov8m.yaml, …
-
### Your current environment
```text
cuda 12.1 simple pip install vllm
```
### 🐛 Describe the bug
`python benchmarks/benchmark_throughput.py --backend vllm --input-len 1024 --output-len …
-
I am trying to evaluate GritLM-7B on MTEB datasets using the provided script.
```
#!/bin/bash
python /home/e/e1347696/unified_encoder_decoder/src/eval/MTEB/eval_mteb.py \
--model_name_or_pat…
-
Look for data that we can use to benchmark our models:
- WOSIS
- HWSD
- SoilGrids
- GSOCmap?
- LandGIS soil map?
- maps of vegetation biomass?
- data on respiration?
- data on NPP?
-
Hi,
I need to download the datasets such as "YFCC-10M + CLIP" to compare between different vector databases.
Where can I find the download links?
-
File "E:\机械故障诊断\DL-based-Intelligent-Diagnosis-Benchmark-master\CNN_Datasets\O_A\datasets\SEU.py", line 27, in get_files
datasetname = os.listdir(os.path.join(root, os.listdir(root)[2])) # 0:b…
-
I encountered several issues when trying to train on the lom dataset and reproduce the author's results:
1. First, I found that in lmo2poet.py, the division method for the lmo dataset is quite diff…
-
The above two datasets are also frequently used benchmarks in few-shot-learning
Do you have any plans to provide code support for that part?
-
Hi,
I hope you’re doing well. I was working with the `benchmark.py` script and noticed that all the dataset references (such as `haideraltahan/wds_cifar10`、`haideraltahan/wds_food101`) appear to be…