xpdAcq / mission-control

Releases, Installers, Specs, and more!
0 stars 4 forks source link

TST: integration tests at beamline #41

Open CJ-Wright opened 6 years ago

CJ-Wright commented 6 years ago

It would be nice to have a series of xpdAcq/xpdAn tests which are run with live beam whenever the software is updated

Expected Behavior

If tests pass software is ready to go, else software nees some work.

Current Behavior

We don't do this so the first users are the test users

Possible Solution

Write some tests in collaboration with BLS similar to bluesky tests

sbillinge commented 6 years ago

I think this is a request for acceptance tests.

@sghose @milinda2014 @dooryhee , we agree this would be awesome to have. We would like to have some more discussion about the scope. For example, should it run examples using special environments. If so, should they be mocked (i.e., simulated) or real. If real, then it will require BLS to have the relevant things running.

We may be able to find a middle ground, for example, the temperature controller is running but the cryocooler is not cooling, to speed things up, but this needs to be explored. Also, we don't want to run pathological tests (e.g. it can only test a room temperature setpoint).

Needs some thought and some testing before we code anything.

sbillinge commented 6 years ago

per @CJ-Wright we should break the tests out into a) no beam, no environments tests (cheap and easy) b) beam, no environments c) environments, no beam d) environments + beam

chiahaoliu commented 6 years ago

Moving to 2018 cycle 2 as we need more inputs from beamline scientists.

CJ-Wright commented 6 years ago

Moving off milestone since we still need input from @xpdAcq/bls