enso-org / enso

Hybrid visual and textual functional programming.
https://enso.org
Apache License 2.0
7.34k stars 320 forks source link

Add filter cmdline option to tests #8998

Closed Akirathan closed 6 months ago

Akirathan commented 7 months ago

There is Suite.run_with_filter spec_filter group_filter method that allows to filter specs or groups. There are many main methods in tests that call into that method. Let's add an optional filter that can be passed from the cmd line. The filter will be just a single argument that will be first treated as a text and will try to match both groups and specs. If there are no matches, the filter will be interpreter as a regex.

### Tasks
- [x] Add filter cmd line option
- [x] Print pending groups
enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-13):

Progress: - Engine benches work, let's see if there will be any regressions or compile problems after the dailies.

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for yesterday (2024-02-14):

Progress: - Designing the new filter option to Suite.run_with_filter.

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-15):

Progress: - filter from cmdline is ready for review https://github.com/enso-org/enso/pull/9065

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-16):

Progress: - Surprisingly, Base_Tests are failing:

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new 🔴 DELAY for today (2024-02-19):

Summary: There is 5 days delay in implementation of the Add filter cmdline option to tests (#8998) task. It will cause 5 days delay for the delivery of this weekly plan.

Running the tests with filter revealed some unexpected issues in the engine related to the partial evaluation in Truffle

Delay Cause: Bumped into unexpected issues with the tests

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-19):

Progress: - Array_Proxy test fixed by fixing a GraalVM PE - related issue when checking arguments for ArrayProxy.

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-20):

Progress: - Created PR that ensures the correct versions of Java and GraalVM are used: https://github.com/enso-org/enso/pull/9106

enso-bot[bot] commented 6 months ago

Pavel Marek reports a new STANDUP for today (2024-02-21):

Progress: - Fixed the issue with atom with hole cashing after consultation with Jaroslav.