-
Regarding Fig. 8b, could you help clarify details about the validation dataset?
Using the released SAE_SPN, I used 500 randomly cropped 512x512 patches from Cityscapes validation images (leftImg8bit)…
-
[ ] I have checked the [documentation](https://docs.ragas.io/) and related resources and couldn't resolve my bug.
**Describe the bug**
I am able to calculate 4 metrics {'faithfulness': 1.0000, 'an…
-
dear author,
I am facing difficulty in the implementation of evaluation metrics like MI, NMI, FMI in python. If you can add python code of same here I will be a great help.
-
> Please provide us with the following information:
> ---------------------------------------------------------------
### This issue is for a: (mark with an `x`)
```
- [x] bug report -> please…
-
Hi,
I wanted to know how would we fetch the batch id/index of the eval dataset in ```preprocess_logits_for_metrics()``` ?
Thanks in advance!
-
Hi, now my evaluation on other datasets is normal. However, when I run the same prcocess:
python tools/calc_metrics_for_dataset.py --real_data_path path/to/sky_timelapse/sky_train/ --fake_data_p…
-
Hi! Thanks for your great work.
I'm trying to reproduce your results, and I would like to know if you could make your evaluation script available. I have tried to use LION repo evaluation script, b…
-
Hi there,
When loading test datasets, your code used "sklearn.preprocessing.StandardScaler" to scale the original datasets. So, in order to produce the correct testing results, it is expected to sc…
-
It takes two hours to evaluate two indicators with 500 data records. Is there any method to accelerate the evaluation?
-
Several information retrieval "tasks" use a few common evaluation metrics including mean average precision (MAP) [1] and recall@k, in addition to what is already supported (e.g. ERR, nDCG, MRR). Somet…