The displayed units only change every third power (i.e. for 0, 3, 6, etc), but the line below scales the exposure time with the actually given precision so the display will be off by up to a factor of 100. For example a precision of -4 in a camera will show units of "ms", but 1 ms exposure is shown as 10 ms.
The displayed units only change every third power (i.e. for 0, 3, 6, etc), but the line below scales the exposure time with the actually given precision so the display will be off by up to a factor of 100. For example a precision of -4 in a camera will show units of "ms", but 1 ms exposure is shown as 10 ms.
https://github.com/nion-software/nionswift-instrumentation-kit/blob/e33ae772458e3da0c91bb3f7a56b32fd0d185f7c/nionswift_plugin/nion_instrumentation_ui/CameraControlPanel.py#L816