Currently, for integration tests, we're creating a big initial state for lp tests from where all test cases are running. Nevertheless, most test cases do not need so many created things for running. The initial state for each test case is taking around 18 secs or so + 1-2 secs of the own test case.
Using a more fine-grained parameterized setup, I'm pretty sure we could reduce that to 5 seconds or less.
Given that we have 50 lp test cases, executed for 2 runtimes each, if we save 12 seconds per tests, it means 1200 seconds, which is 20 min of CI saved
Description
Currently, for integration tests, we're creating a big initial state for
lptests from where all test cases are running. Nevertheless, most test cases do not need so many created things for running. The initial state for each test case is taking around 18 secs or so + 1-2 secs of the own test case.Using a more fine-grained parameterized setup, I'm pretty sure we could reduce that to 5 seconds or less.
Given that we have 50
lptest cases, executed for 2 runtimes each, if we save 12 seconds per tests, it means 1200 seconds, which is 20 min of CI saved