search

neulab / explainaboard_web

MIT License
8 stars 2 forks source link

`generate_dataframe_from_sys_infos` fails when dataset exists that is a prefix of another dataset #571

Closed neubig closed 1 year ago

neubig commented 1 year ago

In the benchmark functionality, generate_dataframe_from_sys_infos fails when a dataset name exists that is a prefix of another dataset, like "cr".

  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/controllers/default_controller.py", line 76, in benchmark_get_by_id
    return default_controllers_impl.benchmark_get_by_id(benchmark_id, by_creator)
  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/impl/default_controllers_impl.py", line 204, in benchmark_get_by_id
    orig_df = BenchmarkDBUtils.generate_dataframe_from_sys_infos(config, sys_infos)
  File "/Users/gneubig/work/explainaboard_web/backend/src/gen/explainaboard_web/impl/db_utils/benchmark_db_utils.py", line 209, in generate_dataframe_from_sys_infos
    raise ValueError(
ValueError: Could not find dataset cr, None