Currently we just tell Travis in the config what platforms/devices to run on, and then hope that paramedic works as designed and the tests are actually run on the correct device/platform.
Maybe we can somehow write some tests that check if a run actually uses the correct device and OS version? https://github.com/apache/cordova-plugin-device could return platform and version, maybe also the model.
The wanted values are available via the paramedic config (platform, sauceDeviceName, saucePlatformVersion or target). Those could for example be used as a param when installing a plugin or written into a file that the tests compares to.
Currently we just tell Travis in the config what platforms/devices to run on, and then hope that paramedic works as designed and the tests are actually run on the correct device/platform.
This leads to problems like https://github.com/apache/cordova-paramedic/issues/163 where this is not true and we are relying on wrong information.
Maybe we can somehow write some tests that check if a run actually uses the correct device and OS version? https://github.com/apache/cordova-plugin-device could return platform and version, maybe also the model.
The wanted values are available via the paramedic config (
platform,sauceDeviceName,saucePlatformVersionortarget). Those could for example be used as a param when installing a plugin or written into a file that the tests compares to.