microsoft / testfx

MSTest framework and adapter
MIT License
716 stars 253 forks source link

MSTestv2 does not support testSettings. Are there features that need to be brought fwd to runSettings? #24

Closed sbaid closed 6 years ago

sbaid commented 7 years ago

Description

TestSettings are not supported in MSTestv2. Are there features that need to brought forward in runsettings?

sbaid commented 7 years ago

@pvlakshm to keep u in loop

AbhitejJohn commented 7 years ago

Here is the list of gaps:

  1. Test settings supports remote execution - This is more of a request on the test platform.
  2. Session level test timeout. Tracked by #26.
  3. There are a list of Legacy system based data collectors(Event Log, Screen and Video Capture etc) that we currently cannot specify via runsettings. Hence these cannot be run with MSTest V2.
  4. Setup and cleanup scripts aren't available in runsettings.
  5. Testsettings supported Host types, the defaults being (VS IDE/ ASP.Net) enabling users to run tests against these hosts. There is no way of achieving this today with MSTest V2 and the new test platform without the legacy engine.
AbhitejJohn commented 7 years ago

/cc @codito , @pvlakshm.

pvlakshm commented 6 years ago

MSTest V2 will not support .testsettings. Getting .runsettings to parity will be taken up as a separate item.