search

neutrons / PyVDrive

A data reduction and analysis software for (SNS) VULCAN based on PyQt.
2 stars 0 forks source link

Fixing issues encountered in user tests and benchmark test #116

Closed wdzhou closed 5 years ago

wdzhou commented 6 years ago

Benchmark Test:

Regular User Tests include

  1. Viewing various type of reduced data in the same session including loaded GSAS file (single and chopped) and in-memory workspaces including sliced.
  2. Comparing reduced workspaces between SNSPowderReduction and reduction 2.0 in PyVDrive.
  3. Process vanadium files
wdzhou commented 6 years ago

09.26 Test case:

short test run:

chop, ipts=20861,runs=165492,dbin=60, output='/home/wzz/Temp/': 20 seconds for 30 outputs

long benchmark run:

chop, IPTS=21356, Runs=161364, dbin=60, output='~/Temp/'

Runtime = 1122.51944184 Total output workspaces = 1476 Duration = 88494.9296875 seconds Number of events = 3,113,288,099 Execution time = 1174.135741 seconds Loading = 222.55793786 Chopping = 611.384680986 Focusing = 161.518967152 SaveGSS = 127.057855844 24 threads

"Run: chop, IPTS=21356, Runs=161364, dbin=10, output='/SNS/users/wzz/Temp'"

CHOP command preparation: 0.000745058059692 seconds Run 161364: duration = 2695.46931291 Execution time = 2695.47054887 seconds /SNS/VULCAN/IPTS-21356/nexus/VULCAN_161364.nxs.h5: Runtime = 2640.8933959 Total output workspaces = 8851 number of thread = 24: Loading = 213.836159945 Chopping = 913.17315197 Focusing = 726.43038106 SaveGSS = 787.453702927

wdzhou commented 6 years ago

IDL cheat sheet

[wzz@analysis-node12 vdrive]$ idl IDL Version 7.1.1 (linux x86_64 m64). (c) 2009, ITT Visual Information Solutions Installation number: 222151. Licensed for use by: Oak Ridge National Laboratory

IDL> @VDRIVEbeta IDL> chop,ipts=12180,runs=67704,dbin=60,loadframe=1

wdzhou commented 6 years ago

VDRIVE benchmark:

  1. number of events = 517,257,172
wdzhou commented 6 years ago

Test on analysis-node12:

chop, IPTS=21356, Runs=161364, dbin=60, output='/SNS/users/wzz/Temp Grand duration = 704.145654917 CHOP command preparation: 0.00113296508789 seconds Execution time = 704.147140026 seconds

/SNS/VULCAN/IPTS-21356/nexus/VULCAN_161364.nxs.h5: Pure Runtime = 651.043458939 Total output workspaces = 1476Details for thread = 24: Loading = 189.63080883 Chopping = 211.073724031 Focusing = 108.538669109 SaveGSS = 141.800256968

wdzhou commented 6 years ago

VDRIVE command chop is executed successfully (CHOP command preparation: 0.00034499168396 seconds Run 161364: duration = 513.163578033: IPTS-21356 Run 161364 is chopped, reduced? True and saved to /SNS/users/wzz/Temp Warning: Workspace "{}" does not exist

Execution time = 513.164451838 seconds). Out[1]: "Run: chop, IPTS=21356, Runs=161364, dbin=600, output='/SNS/users/wzz/Temp'"

/SNS/VULCAN/IPTS-21356/nexus/VULCAN_161364.nxs.h5: Runtime = 450.274181128 Total output workspaces = 149Details for thread = 24: Loading = 282.57201004 Chopping = 78.4148910046 Focusing = 77.2323200703 SaveGSS = 12.0549600124

wdzhou commented 6 years ago

VDRIVE command chop is executed successfully (CHOP command preparation: 0.00034499168396 seconds Run 161364: duration = 513.163578033: IPTS-21356 Run 161364 is chopped, reduced? True and saved to /SNS/users/wzz/Temp Warning: Workspace "{}" does not exist

Execution time = 513.164451838 seconds). Out[1]: "Run: chop, IPTS=21356, Runs=161364, dbin=600, output='/SNS/users/wzz/Temp'"

/SNS/VULCAN/IPTS-21356/nexus/VULCAN_161364.nxs.h5: Runtime = 450.274181128 Total output workspaces = 149Details for thread = 24: Loading = 282.57201004 Chopping = 78.4148910046 Focusing = 77.2323200703 SaveGSS = 12.0549600124

wdzhou commented 6 years ago

Bug report (2018.11.07)

In Reduction Data View, the contour plot is not correct. It seems that there is only one diffraction pattern that is read in and plotted for many times.

wdzhou commented 5 years ago

The high-level issue #140 is taking care of the daily bug report for existing reduction features. Thus this issue shall be closed.