Unscripted Testing ISIS SANS - Githubissues

mantidproject / mantid

Main repository for Mantid code

https://www.mantidproject.org

GNU General Public License v3.0

210 stars 123 forks source link

Unscripted Testing ISIS SANS #22762

Closed keeeto closed 6 years ago

keeeto commented 6 years ago

You have been assigned unscripted testing. The hope is to catch as many problems with the code before release, so it would be great if you can take some time to give a serious test to your assigned area. Thank you!!

The general guide to unscripted testing:

The tests must be performed on the installer versions of the final release candidate. Not on local compiled code.
Serious errors involving loss of functionality, crashes etc. should be raised as issues with the current release as a milestone and an email sent to the project manager immediately.
Minor and cosmetic issues should be raised as issues against the forthcoming releases.
First try things that should work, then try to break Mantid, e.g. entering invalid values, unexpected characters etc.
Don't spend more than a few hours on the testing as fatigue will kick in.
If you find errors in the documentation, please correct them.
Comment against this ticket the OS environment you are testing against.
Close the this issue once you are done.

Specific Notes:

See http://www.mantidproject.org/SANS_Data_Analysis_at_ISIS

KarlPalmen commented 6 years ago

Installing Mantid nightly.

KarlPalmen commented 6 years ago

Testing Mantid 3.12.20180703.1554 .

KarlPalmen commented 6 years ago

Testing on Windows 7.

KarlPalmen commented 6 years ago

The button to load the User File was called "Load Mask" and the only such file in the loqdemo folder was called MaskFile.txt . This took me some time to figure out. Documentation referred to in test instructions may need improving.

KarlPalmen commented 6 years ago

The user file produced the same settings early on, but leter ones were different and I could not identify where the range 0.13 to 0.25 would be. I've been unable to do basic reduction with this and error messages are not helpful.

KarlPalmen commented 6 years ago

I've found out that despite the error messages the reduction was successful and produced the workspaces described. Unlike the muon interface, plotting is not automatically done.

KarlPalmen commented 6 years ago

It seem to work OK, but did crash when playing around with it roughly. I used the report facility to report it under name "Karl #22762" .

KarlPalmen commented 6 years ago

I tried getting it to crash again and it did not.

KarlPalmen commented 6 years ago

It seems OK for me, except that the issue of confusion between mask files and user files needs addressing.

KarlPalmen commented 6 years ago

I found out that the documentation is in the wiki, so I made a small change to say the the user file can be reffered to as a mask file.