Add evaluation method - Githubissues

DeNederlandscheBank / nqm

A Transformer-based Machine for answering questions on insurance companies

MIT License

0 stars 0 forks source link

Closed jm-glowienke closed 3 years ago

jm-glowienke commented 3 years ago

Two evaluation methods added:

String based using BLEU
Results oriented by comparing the results of the true and generated queries This can be done on several test sets. There is also an interactive version to check results for single queries.

Closes #14