search

Meteor-Community-Packages / meteor-mocha

A Mocha test driver package for Meteor 1.3+. This package reports server AND client test results in the server console and can be used for running tests on a CI server or locally.
https://packosphere.com/meteortesting/mocha
MIT License
67 stars 40 forks source link

Why do tests run slower than with `practicalmeteor:mocha`? #23

Open thebarty opened 7 years ago

thebarty commented 7 years ago

Hi guys,

I found that my test-suite runs much slower using this package (SERVER-side ONLY tests) than running them with practicalmeteor:mocha. It is NOT only this package - I have also tried practicalmeteor:mocha-xunit-reporter which is unusable as it hits the 120minute limit on CircleCi.

Here are some results: dispatch:mocha OSX => 291 passing (26m) dispatch:mocha CircleCi => NOT yet tested practicalmeteor:mocha OSX => 263 passing (17m) // WINNER practicalmeteor:mocha-xunit-reporter OSX => NOT yet tested practicalmeteor:mocha-xunit-reporter CircleCi => hits the 120minutes limit (=UNUSABLE)

I am just wondering... maybe someone else is experiencing this too. And maybe someone finds a performance hack

0o-de-lally commented 7 years ago

@thebarty I'm also perplexed at this. Some of my integration tests failed on timeout when I first started using dispatch. I don't see anything in the dipatcha:mocha code that is blocking. Practicalmeteor:mocha's code is far more complex.

thebarty commented 7 years ago

@keyscores Strange stuff, but I can definetly confirm that for my tests this is the correct data. I just had my first successful pass using dispatch:mocha on CircleCi. So the new data looks like this:

dispatch:mocha OSX => 291 passing (26m) dispatch:mocha CircleCi => 291 passing (24m) // Wohaa! Faster than on OSX. Faster than practicalmeteor:mocha-xunit-reporter practicalmeteor:mocha OSX => 263 passing (17m) practicalmeteor:mocha-xunit-reporter OSX => NOT yet tested practicalmeteor:mocha-xunit-reporter CircleCi => hits the 120minutes limit (=UNUSABLE)

Are you experiencing similar results?

This is the setup I am using (last topic) https://forums.meteor.com/t/enhanced-but-simply-stupid-circleci-setup-that-first-runs-unit-integration-tests-and-then-chimp-acceptance-tests/35086/7

aldeed commented 7 years ago

@thebarty Interesting. I don't really have any ideas. Both packages rely on the same core mocha package and operate pretty much the same way for running server tests. We can accept a PR if anyone can figure out some solution.