search

samisagit / natskell

A NATS client library written in Haskell
MIT License
7 stars 0 forks source link

Make a generated test suite #67

Closed samisagit closed 1 year ago

samisagit commented 2 years ago

The INFO generated test cases take ~9 minutes to complete, having generated 5 million examples. Not helpful for a tight feedback loop so we'll exclude generated cases from the unit test suite.

samisagit commented 2 years ago

This was easier to implement as a Makefile target, excluding generated tests by default. This requires the describe value to be "generated" in the tests that should be ignored. Another target has been created for generated tests that will also be run in CI

samisagit commented 2 years ago

Cut these down a fair amount by making some changes to the scope of this.

  1. Only put in truly expected values into generated tests (explicit and regression tests should cover missed cases)
  2. There is only value to making generated test for the parsers, transformers are implemented too simply to actually benefit from this kind of testing.