biocypher / biochatter

Backend library for conversational AI in biomedicine
http://biochatter.org/
MIT License
51 stars 19 forks source link

Use encrypted test dataset #123

Closed nilskre closed 4 months ago

nilskre commented 4 months ago

No big changes here. Just two rather small things:

120 adapt the encrypted test workflow to the new yaml syntax

121 added some new test cases to the encrypted llm-test-dataset

Probably next: automatically load the encrypted test dataset release in the benchmarking routine automatically (if the env variable is set)

nilskre commented 4 months ago

Fixed the open points:

Now ready to be reviewed @slobentanzer

nilskre commented 4 months ago

Now adapted as discussed (kg schema not duplicated any more)