Benchmark Suite for Compiler - Githubissues

cqframework / clinical_quality_language

Clinical Quality Language (CQL) is an HL7 specification for the expression of clinical knowledge that can be used within both the Clinical Decision Support (CDS) and Clinical Quality Measurement (CQM) domains. This repository contains complementary tooling in support of that specification.

https://confluence.hl7.org/display/CDS/Clinical+Quality+Language

Apache License 2.0

251 stars 121 forks source link

Benchmark Suite for Compiler #1280

Open JPercival opened 8 months ago

JPercival commented 8 months ago

The CQL engine has a basic Benchmark suite that's located here: https://github.com/cqframework/clinical_quality_language/blob/a856e39970695e653cf41be26cae804c361b5f40/Src/java/engine/src/test/java/org/opencds/cqf/cql/engine/execution/CqlPerformanceIT.java#L18

We need a similar set of tests for the CQL compiler. This should consist of:

Tests for Parser performance
- CQL main suite
- WHO content that contains grammatical ambiguities
Tests for ELM generation performance
- CQL main suite
End-to-end performance
- CQL main suite
- Representative CDS content (Opioid content)
- Representative Measure content (BCS Measure)
- FhirPath / Expressions
- Use of various models, at least FHIR and QICore
- Content that produces many compiler warnings, such as hidden identifiers.