Sometimes generators have bugs where they generate valid but unintended data, and you only find them after a while by inspecting the generated .in files manually.
Maybe we could come up with some simple and clean way to test that generators do what was intended. Maybe something like the following in generators.yaml:
On the other hand, I'm not exactly sure how useful it is to only be able test for substring containment. But writing code to detect arbitrary patterns and executing that sounds like a lot of overhead.
Sometimes generators have bugs where they generate valid but unintended data, and you only find them after a while by inspecting the generated
.infiles manually.Maybe we could come up with some simple and clean way to test that generators do what was intended. Maybe something like the following in
generators.yaml:On the other hand, I'm not exactly sure how useful it is to only be able test for substring containment. But writing code to detect arbitrary patterns and executing that sounds like a lot of overhead.