search

exe1023 / DialEvalMetrics

60 stars 11 forks source link

Unable to reproduce results #6

Open arpitdwi opened 2 years ago

arpitdwi commented 2 years ago

I'm unable to get the desired results by following the steps as given in the README due to multiple issues such as:- 1) Environment creation failures for some of the them 2) gen_data.py is giving errors for DSTC6 and Engage 3) Transformers version issues for FBD, Maude (Eval_base environment) and TF version issues for run_bert_as_service.sh and some others as well. 4) Various files such as restore/ensemble.yml, ./data/DailyDialog/keyword.vocab etc. not being present So I request to update the repository with the latest codes and files if possible to help get the results as highlighted in your paper.

jsedoc commented 2 years ago

@arpitdwi were you able to solve any of there issues?

arpitdwi commented 2 years ago

@jsedoc No so I ended up not using this repo for my baseline results.