Now EvaluationRepository will use tid and tids for all methods instead of dataset or dataset_names.
Note: tid naming convention is not yet propagated to zeroshot_context. That can be in a later PR as it is a lower layer that won't be directly accessed in most scenarios.
Note: @geoalgo I'm merging so I can try to rebase #9 to avoid excess merge conflicts. Please feel free to still review and I can address comments in a follow-up PR
Implements alignment for follow-up items in #10
Specifically
task_id, dataset, tid
alignment.Now
EvaluationRepository
will usetid
andtids
for all methods instead ofdataset
ordataset_names
.Note:
tid
naming convention is not yet propagated tozeroshot_context
. That can be in a later PR as it is a lower layer that won't be directly accessed in most scenarios.