NAVDEMO / RunTests

5 stars 7 forks source link

add sample AL test app that autoloads tests on install #1

Closed MikeGlue closed 5 years ago

MikeGlue commented 5 years ago

If helpful with testing, I added a sample test app that loads the tests on install of the app so doesn't have to be done manually. also had to restructure the repo....sorry ;)

freddydk commented 5 years ago

Thanks Mike

The repository is very much temporary for people to run their tests and give me feedback that this mechanism of running the tests works.

Having said that – I can easily see the idea and it really belongs in the test app in the CI/CD repository (I think). Currently I use an invoke-codeunit to populate (and invoke-codeunit to run tests)

A few questions

Wouldn’t every app create separate test suites?

Do we have “magic” test suite names – where an app could add its own tests? (you could imagine a smoketest test suite which should contain all smoketest tests from all apps)

/Freddy

From: Mike Glue notifications@github.com Sent: 17. februar 2019 07:36 To: NAVDEMO/RunTests RunTests@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [NAVDEMO/RunTests] add sample AL test app that autoloads tests on install (#1)

If helpful with testing, I added a sample test app that loads the tests on install of the app so doesn't have to be done manually. also had to restructure the repo....sorry ;)


You can view, comment on, or merge this pull request online at:

https://github.com/NAVDEMO/RunTests/pull/1https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FNAVDEMO%2FRunTests%2Fpull%2F1&data=02%7C01%7Cfreddy.kristiansen%40microsoft.com%7C22a5bfd904754ebbe06f08d694a22586%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636859821470115554&sdata=pPUYizQLIiU1sUitod9HmkiuU%2Br56dhqgTvlqnUKplE%3D&reserved=0

Commit Summary

File Changes

Patch Links:

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FNAVDEMO%2FRunTests%2Fpull%2F1&data=02%7C01%7Cfreddy.kristiansen%40microsoft.com%7C22a5bfd904754ebbe06f08d694a22586%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636859821470175523&sdata=seW9bWUTG2iUYhSAB7O5m72KjoxYrVimLcCJQci2TBg%3D&reserved=0, or mute the threadhttps://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAKRqA0j2r-i0c_UkUGrxf938rus1J0qtks5vOPhBgaJpZM4a_ZZe&data=02%7C01%7Cfreddy.kristiansen%40microsoft.com%7C22a5bfd904754ebbe06f08d694a22586%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636859821470175523&sdata=Pvy3gp2y%2BOPQqZ00Qk6dtgyCimnc0erCwFFEMIujmF8%3D&reserved=0.

MikeGlue commented 5 years ago

Yeah figured the exaple could be useful somewhere, just put it here for now at least. The way we plan on doing things is every test app will create its own test suite so that we can report on the results of each app independently. For a full regression test we'd just run each test suite in serial. The example could be changed to allow adding of tests to a single test suite. It is a bit more challenging in the event tests are removed from an app though.

If some sort of grouping was added so we could run a group of test suites then that would make things a lot easier. I agree, it might be nice to run your entire set of smoke tests across all apps at once. Maybe a simple product enhancenemt that can be made? ;)

freddydk commented 5 years ago

Thanks a million for this Mike - i have done a few mods and added it to the test-app which is the foundation of my CI/CD blog post series, here: https://dev.azure.com/businesscentralapps/_git/HelloWorld?path=%2Ftest&version=GBmaster Only problem right now is that two apps will delete the tests added by the other - will fix this. Also the sample is now using Run-TestsInNavContainer for CI - works really well. Will close this PR.