biocypher / biochatter

Backend library for conversational AI in biomedicine
http://biochatter.org/
MIT License
51 stars 19 forks source link

[PDSM] Medical Testcases for benchmarking #157

Open ytehran opened 1 month ago

ytehran commented 1 month ago

Please note, that this PR is still in work

What does this PR do?

Notes

For the analysis: Adaption of benchmark_utils for the failure_groups and added new methods To test for synonyms, “nltk” is used, which must

  1. be installed e.g. pip install nltk
  2. Downloaded by commenting line 26 in our test.py
ytehran commented 3 weeks ago

@slobentanzer Wir haben jetzt einen Teil der SW Engineering umgesetzt und die Fragen anpasst. Wir wären ready um den großen Durchlauf zu machen