search

racket / pkg-build

Other
5 stars 9 forks source link

Expected test failures #1

Open tonyg opened 8 years ago

tonyg commented 8 years ago

Sometimes, we expect certain tests to fail specifically when they are run in the build environment.

For example, racket-packet-socket tries to get raw access to an ethernet device, which will clearly fail in the build sandbox. This makes it look like there are failing tests in racket-packet-socket in all the places that the build-server's output is shown to users (e.g. build-server UI itself; package catalog UI), even though that's sort-of not really the case.

It would be nice to have some way of saying either "I expect this and that file to fail its tests in this or that way when run on the build server", or "O build-server, do not run tests for this and that file!"

mflatt commented 7 years ago

Sorry that I lost track of this issue.

Does the PLT_PKG_BUILD_SERVICE environment variable (or the new CI environment variable) provide what you want for this case? See https://pkg-build.racket-lang.org/about.html for more info.