WebTestCase performance optimization

[AronNovak]

will fix #170

Status

merely the patch is there

Todo

check with real tests, check if any further steps are needed

[amitaibu]

Note:

The thing is opt-in. You will need to put --cache for the test runner for that to work.

[AronNovak]

0.3/4h

What's left:

• add a basic Simpletest into the Hedley group
• make sure Travis calls Simpletest correctly
• check the benefit of the patch

[amitaibu]

add a basic Simpletest into the Hedley group

You can run core's tests

[AronNovak]

Actually there are tests in the Hedley group:

That's likely a good opportunity to fix (or drop) these tests (in another PR).

[bitamar]

I think I added these tests. I'll have a look.

[AronNovak]

Local performance test on SimpleTest group: without the --cache option.

with the --cache option.

with the --cache and --cache-modules option.

so the final execution time is 77% of the original one at localhost. Maybe in the cloud, with worse IO, the benefit is even greater, going to check soon.

[AronNovak]

So the same three cases are being tested right now in the cloud.

[bitamar]

The Hedley tests should be passing with #174

[AronNovak]

Test results from Travis with SimpleTest test case (Hedley is not meaningful with only one test):

no caching

https://travis-ci.org/Gizra/drupal-elm-starter/jobs/283675496

 > Starting SimpleTest tests 
Thu Oct  5 13:01:16 UTC 2017
> Finished SimpleTest tests 
Thu Oct  5 13:03:22 UTC 2017

Total time: 126 seconds (100%)

--cache option

https://travis-ci.org/Gizra/drupal-elm-starter/jobs/283674325

> Starting SimpleTest tests 
Thu Oct  5 12:48:20 UTC 2017

 > Finished SimpleTest tests 
Thu Oct  5 12:49:45 UTC 2017

Total time: 85 seconds (67%)

--cache --cache-modules options

https://travis-ci.org/Gizra/drupal-elm-starter/jobs/283674971

> Starting SimpleTest tests 
Thu Oct  5 12:57:20 UTC 2017
 > Finished SimpleTest tests 
Thu Oct  5 12:58:40 UTC 2017

Total time: 61 seconds (48%)

That's impressive, I must say.

[AronNovak]

I think it"s ready for review, and then, ready to propagate to all projects with non-trivial SimpleTest coverage (where there's only one single test case, like at Hedley group here, it does not help actually).

[amitaibu]

👍 MWG