search

kuzudb / kuzu

Embeddable property graph database management system built for query speed and scalability. Implements Cypher.
https://kuzudb.com/
MIT License
1.02k stars 77 forks source link

Testing framework improvement #2630

Open acquamarin opened 3 months ago

acquamarin commented 3 months ago
  1. Allow fuzzy matching on test result. E.g. A test throws an exception message which is dependent on the test running path.
  2. Allow numeric value comparison with precision. E.g. Floating value is imprecise and dependent on different platforms.
  3. Disable certain tests on certain platform. (different testing results on different platforms)

  4. 2308

  5. Support initialize test case on existing binary db directory instead of csv/parquet files. This is needed by the storage compatibility test (#2944).
semihsalihoglu-uw commented 3 months ago

@acquamarin: Are there existing tests in our codebase that would benefit from these? If so,can you point to several example such tests? Or are there example tests we are not adding right now because these issue remains unsolved? If so, can you point to several of those. I'm trying to understand the issue and its benefits better.

ray6080 commented 1 month ago

An additional point to make the usability better here: we should consider interring the test group name directly from test file path. For example, common/types/interval.test will automatically be registered as -GROUP common.types. This can save the efforts to find the location of the test file given a test name. Manually written test group names can be irrelevant to the test file name.