prebid / prebid-universal-creative

Apache License 2.0
43 stars 71 forks source link

Integration tests #180

Open dgirardi opened 2 years ago

dgirardi commented 2 years ago

Integration tests; this aims to be exhaustive, but is a WIP.

Cases covered so far:

In progress:

Missing:

Not supported by PUC (!)

musikele commented 1 year ago

The biggest issue with this PR is that running tests is aleatory. Basically, all tests may fail because of network, cpu, bandwith, google deciding that we're overcalling their endpoint, and other thousand million causes that it'll be impossible to say "oh, tests are failing because it's my fault".

Another issue is that these tests take several minutes to run. On a local pc they may take up to 5-6 minutes. So they're only suitable for a CI environment.

So, probably if we remove some tests, or some browsers, and we keep the run timing under 2 minutes, and we tweak the parameters so that tests failing go to zero, this is the test suite we were missing