issues
search
DeNederlandscheBank
/
nqm
A Transformer-based Machine for answering questions on insurance companies
MIT License
0
stars
0
forks
source link
[High priority] Data generation, tokenization and BPE missing
#16
Closed
jm-glowienke
closed
3 years ago
jm-glowienke
commented
3 years ago
[x] include dashes in queryies --> this maybe solves
https://github.com/DeNederlandscheBank/nqm/issues/15
[x] Tokenize and detokenize filled nl questions using Moses
[x] Change handyish tokenization for SPARQL queries, include quoatation marks
[x] Add BPE --> will probably improve perfomance, frequent patterns are simplified
jm-glowienke
commented
3 years ago
[x] Clean up folders,
[x] Clear up script