web-platform-tests / wpt

Test suites for Web platform specs — including WHATWG, W3C, and others
https://web-platform-tests.org/
Other
4.91k stars 3.06k forks source link

Reduce dependence of infra tests on external servers #9057

Open gsnedders opened 6 years ago

gsnedders commented 6 years ago

In https://github.com/w3c/web-platform-tests/commit/b4b9ec466d8f719da9876c00afcf709529f1e4a6 I added a bunch of markers to a number of tests, including "remote_network".

While we might want integration tests to check our "install x" support works properly, we can test the majority of this code without relying on external servers.

foolip commented 6 years ago

Is this about replying on servers to download foodrivers and the like, not about the tests themselves pointing to external servers? How would one reduce the former meaningfully?

gsnedders commented 6 years ago

@foolip Yes. I was envisioning mocking out the download side of things and being able to test things in isolation from external servers.

foolip commented 6 years ago

Oh, I see, so it's not about hosting those downloads somewhere else, but testing the things that involve the download incidentally.