DeNederlandscheBank / nqm

A Transformer-based Machine for answering questions on insurance companies
MIT License
0 stars 0 forks source link

Generation of test sets is slow #9

Closed jm-glowienke closed 3 years ago

jm-glowienke commented 3 years ago

When building the test files, the generator is called multiple times with different file types. However, everytime the generator is called, the graph has to be initialized and this slows down the process.

What should be done:

By this, the generator function has to be only called once for the test files and this speeds up the generation process. Especially when the graph is getting bigger.