search

RadioAstronomySoftwareGroup / pyuvsim

A ultra-high precision package for simulating radio interferometers in python on compute clusters.
https://pyuvsim.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
42 stars 7 forks source link

Enterprise vs Oscar reference simulations #150

Closed mkolopanis closed 5 years ago

mkolopanis commented 5 years ago

not 100% it's an issue, but wanted to at least track some outputs here for the oscar vs enterprise discussion.

After some, mishaps, I have managed to get output files from pyuvsim on enterprise. I've made a little script that compares two uvdata objects with the == operator to get the pyuvdata object, but also calls np.allclose and np.array_equal on the data arrays. The last two I've added because some changes have happened even in pyuvdata since v0.1.0 so it's possible some of the meta data might be handled differently and I wanted explicit checks on the data_arrays as well.

also these are being compared to values simulated with v0.0.1 they were the reference simulations I had on hand but I might have v0.1.0 too somewhere.

Here's some comparison files:

ant_1_array parameter value is array, values are not close
parameter _ant_1_array does not match. Left is [ 0  1  2 ... 86 87 87], right is [ 40  41  42 ... 126 127 127]
ant_2_array parameter value is array, values are not close
parameter _ant_2_array does not match. Left is [ 0  0  0 ... 86 86 87], right is [ 40  40  40 ... 126 126 127]
antenna_numbers parameter value is array, values are not close
parameter _antenna_numbers does not match. Left is [ 0  1  2  3  4  5  6  7  8  9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71
 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87], right is [ 40  41  42  43  44  45  46  47  48  49  50  51  52  53  54  55  56  57
  58  59  60  61  62  63  64  65  66  67  68  69  70  71  72  73  74  75
  76  77  78  79  80  81  82  83  84  85  86  87  88  89  90  91  92  93
  94  95  96  97  98  99 100 101 102 103 104 105 106 107 108 109 110 111
 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127]
baseline_array parameter value is array, values are not close
parameter _baseline_array does not match. Left is [ 67585  69633  71681 ... 243799 245847 245848], right is [149545 151593 153641 ... 325759 327807 327808]
history parameter value is a string, values are different
parameter _history does not match. Left is Simulated with pyuvsim version: 0.0.1.  Git origin: https://github.com/H
ERA-Team/pyuvsim.git.  Git hash: cf856ebf3a5554cdde02774e0798ae0a3e599a0
6.  Git branch: reference_sim_changes.  Git description: cf856eb. Source
s from source list: catalog_files/mock_catalog_heratext_2458098.38824015
.txt. Based on config files: obsparam_ref_1.1.yaml, telescope_config/mwa
88_nocore_config.yaml, telescope_config/mwa_nocore_layout.csv Npus = 100
.  Read/written with pyuvdata version: 1.3.1.  Git origin: https://githu
b.com/HERA-Team/pyuvdata.git.  Git hash: 628d570eb16bc20e79fe0fc3db50eb9
75b9fa968.  Git branch: master.  Git description: v1.3-20-g628d570.  Read/written with pyuvdata version: 1.3.3.  Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash: 1ceda98827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git description: v1.3-212-g1ceda98., right is Simulated with pyuvsim version: 0.1.0.  Git origin: git@github.com:HERA-
Team/pyuvsim.  Git hash: 9475ee15165c6c7f2bcc96b350c2d27eb646e28c.  Git
branch: HEAD.  Git description: v0.1.0-dirty. Sources from source list:
catalog_files/mock_catalog_heratext_2458098.38824015.txt. Based on confi
g files: ., telescope_config/mwa88_nocore_config.yaml, telescope_config/
mwa_nocore_layout.csv Npus = 20.  Read/written with pyuvdata version: 1.
3.3.  Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash:
1ceda98827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git desc
ription: v1.3-212-g1ceda98.
antenna_positions parameter value is array, values are not close
parameter _antenna_positions does not match. Left is [[ 2.07511610e+00 -3.37901103e+01 -2.18770176e+01]
 [ 5.78635268e+00 -2.50812642e+01 -1.07194608e+01]
 [-6.93618742e-01 -9.70044322e+00 -1.14337893e+01]
 [ 2.64522815e+00 -5.91497079e+00 -3.87651485e+00]
 [ 5.23812456e+00 -1.48055076e-01  3.75977439e+00]
 [-1.53944936e+00  1.59965831e+00 -5.75107119e+00]
 [-7.95103734e+00  8.16080633e+00 -1.17040185e+01]
 [-1.57727817e+01  1.78489228e+01 -1.77418922e+01]
 [ 2.21125604e+01 -1.23360188e+02 -4.53707958e+01]
 [-2.21968897e+01 -1.43128535e+02 -1.26663364e+02]
 [-1.30923959e+02 -2.78468864e+02 -3.76024515e+02]
 [-2.03038537e+01 -3.46449404e+02 -2.45460069e+02]
 [ 1.64216396e+01 -4.01362046e+02 -2.21179681e+02]
 [ 1.17670814e+02 -3.78954064e+02 -4.81014348e+01]
 [ 7.93651578e+01 -2.81950175e+02 -5.04014900e+01]
 [ 1.20477558e+02 -2.71276493e+02  2.15371240e+01]
 [ 1.89559225e+02 -1.94908540e+01  2.85453259e+02]
 [ 7.32416596e+01 -3.03151550e+01  9.30776901e+01]
 [ 2.55982855e+01  1.35888140e+01  4.42209272e+01]
 [ 3.04099871e+01  5.85189404e+00  4.69938674e+01]
 [ 4.12414355e+01 -1.69791673e+01  5.02105126e+01]
 [ 3.42349160e+01 -1.56801092e+01  3.98244514e+01]
 [ 1.79114365e+02 -2.76026669e+02  1.11886384e+02]
 [ 1.40188382e+02 -1.49603837e+02  1.27052880e+02]
 [-1.64642159e+02  3.64237427e+02 -3.18533620e+01]
 [-1.12741249e+02  2.20550434e+02 -4.10164527e+01]
 [ 2.21221535e-01  7.58794539e+01  4.33511911e+01]
 [ 1.39340691e+01  3.39520471e+01  3.86191724e+01]
 [ 2.14892076e+01  2.66182726e+01  4.58649361e+01]
 [ 3.93637818e+01  5.77354733e+01  9.33465303e+01]
 [ 9.61306992e+01  1.70071704e+02  2.52885262e+02]
 [ 7.54476305e+01  1.99287982e+02  2.38187617e+02]
 [ 3.46659261e+02 -3.41968574e+02  3.37535801e+02]
 [ 3.23350194e+02 -3.20926723e+02  3.13366345e+02]
 [ 2.64856016e+02 -4.35855171e+02  1.50170599e+02]
 [ 2.43824331e+01 -5.41102148e+02 -2.94815680e+02]
 [ 1.64481665e+02 -5.58944071e+02 -8.48601722e+01]
 [ 2.09078145e+02 -5.75345051e+02 -2.46432800e+01]
 [ 2.95933797e+02 -9.65130220e+02 -1.33646408e+02]
 [ 5.05836731e+02 -8.25245505e+02  2.86962952e+02]
 [ 7.67078958e+02  2.10044200e+01  1.22224651e+03]
 [ 3.67576106e+02 -2.12632709e+01  5.65327055e+02]
 [ 2.93075633e+02  6.89972674e+00  4.64917174e+02]
 [ 3.75389573e+02 -5.02107029e+01  5.60165690e+02]
 [ 2.91844208e+02 -1.64663261e+01  4.48866188e+02]
 [ 2.96735686e+02 -7.32322061e+01  4.22209755e+02]
 [ 3.02137236e+02 -1.25952058e+02  3.98814250e+02]
 [ 6.97254868e+02 -6.03377936e+02  7.30364534e+02]
 [ 2.64758917e+02  9.51993799e+02  1.00082362e+03]
 [ 4.74107206e+01  4.06558556e+02  3.24003414e+02]
 [ 1.37528640e+02  3.88475991e+02  4.52736911e+02]
 [ 1.65695297e+02  3.88323783e+02  4.96876064e+02]
 [ 2.24577327e+02  2.32638901e+02  4.92904993e+02]
 [ 2.65621561e+02  1.19495907e+02  4.89267627e+02]
 [ 2.98568770e+02  2.33512047e+02  6.08807992e+02]
 [ 5.28752963e+02  2.87102176e+02  1.00739720e+03]
 [ 2.07263848e+01  9.88943918e+02  6.45009850e+02]
 [-1.65558486e+02  1.27823106e+03  5.32176165e+02]
 [-3.61943182e+02  1.34759959e+03  2.70659447e+02]
 [-2.30552690e+02  5.85428634e+02  4.13552387e+00]
 [-1.81447995e+02  6.21264522e+02  1.02645117e+02]
 [-1.19596894e+02  5.56715045e+02  1.58951003e+02]
 [-7.99434202e+01  6.14969745e+02  2.57227189e+02]
 [ 2.91803455e+01  4.99312936e+02  3.54197899e+02]
 [-4.76266161e+02  1.07426928e+03 -7.39320588e+01]
 [-7.96417592e+02  1.05625079e+03 -5.85062076e+02]
 [-4.50893194e+02  4.37190248e+02 -4.33977695e+02]
 [-2.75094737e+02  2.94087998e+02 -2.49313001e+02]
 [-2.95680766e+02  3.60621247e+02 -2.40112739e+02]
 [-3.85432962e+02  5.11969346e+02 -2.84668046e+02]
 [-3.29910521e+02  4.93442039e+02 -2.09068352e+02]
 [-2.98818435e+02  5.23836095e+02 -1.41307419e+02]
 [-8.76969310e+02  4.36635669e+02 -1.09753148e+03]
 [-7.02745214e+02  2.78576346e+02 -9.24101164e+02]
 [-3.61972802e+02 -1.26734948e+02 -6.40773781e+02]
 [-3.48409742e+02 -1.84271346e+01 -5.55137999e+02]
 [-3.96524992e+02  1.73004205e+02 -5.15224619e+02]
 [-4.09814778e+02  1.94797403e+02 -5.22564085e+02]
 [-4.11902812e+02  2.66709457e+02 -4.81249582e+02]
 [-4.06172255e+02  2.69402172e+02 -4.70811441e+02]
 [-1.86141837e+02 -4.37644959e+02 -5.58552031e+02]
 [-2.90686545e+02 -1.88025117e+02 -5.67943024e+02]
 [-3.54117077e+02 -5.76418005e+02 -9.10414945e+02]
 [-3.41565638e+02 -6.73829102e+02 -9.50251895e+02]
 [-1.98773075e+02 -7.23589396e+02 -7.56811790e+02]
 [-2.69242632e+01 -6.10361918e+02 -4.18412695e+02]
 [ 9.82411093e+00 -5.97909629e+02 -3.53334501e+02]
 [-5.60985065e+01 -5.54280755e+02 -4.29051774e+02]], right is [[-5.93266192e+00 -3.97136044e+01 -3.66460254e+01]
 [-2.22142534e+00 -3.10047584e+01 -2.54884686e+01]
 [-8.70139676e+00 -1.56239374e+01 -2.62027971e+01]
 [-5.36254987e+00 -1.18384649e+01 -1.86455227e+01]
 [-2.76965346e+00 -6.07154921e+00 -1.10092334e+01]
 [-9.54722738e+00 -4.32383582e+00 -2.05200790e+01]
 [-1.59588154e+01  2.23731220e+00 -2.64730263e+01]
 [-2.37805597e+01  1.19254286e+01 -3.25109000e+01]
 [ 1.41047824e+01 -1.29283682e+02 -6.01398037e+01]
 [-3.02046678e+01 -1.49052029e+02 -1.41432372e+02]
 [-1.38931737e+02 -2.84392358e+02 -3.90793523e+02]
 [-2.83116317e+01 -3.52372898e+02 -2.60229077e+02]
 [ 8.41386160e+00 -4.07285540e+02 -2.35948689e+02]
 [ 1.09663036e+02 -3.84877558e+02 -6.28704426e+01]
 [ 7.13573798e+01 -2.87873670e+02 -6.51704979e+01]
 [ 1.12469780e+02 -2.77199987e+02  6.76811615e+00]
 [ 1.81551447e+02 -2.54143482e+01  2.70684252e+02]
 [ 6.52338816e+01 -3.62386492e+01  7.83086822e+01]
 [ 1.75905075e+01  7.66531988e+00  2.94519193e+01]
 [ 2.24022090e+01 -7.16000949e-02  3.22248596e+01]
 [ 3.32336575e+01 -2.29026614e+01  3.54415047e+01]
 [ 2.62271379e+01 -2.16036033e+01  2.50554436e+01]
 [ 1.71106587e+02 -2.81950163e+02  9.71173760e+01]
 [ 1.32180604e+02 -1.55527332e+02  1.12283873e+02]
 [-1.72649937e+02  3.58313932e+02 -4.66223699e+01]
 [-1.20749027e+02  2.14626940e+02 -5.57854606e+01]
 [-7.78655649e+00  6.99559598e+01  2.85821833e+01]
 [ 5.92629103e+00  2.80285529e+01  2.38501646e+01]
 [ 1.34814296e+01  2.06947784e+01  3.10959283e+01]
 [ 3.13560038e+01  5.18119792e+01  7.85775225e+01]
 [ 8.81229212e+01  1.64148210e+02  2.38116254e+02]
 [ 6.74398525e+01  1.93364488e+02  2.23418609e+02]
 [ 3.38651483e+02 -3.47892068e+02  3.22766793e+02]
 [ 3.15342416e+02 -3.26850217e+02  2.98597337e+02]
 [ 2.56848238e+02 -4.41778665e+02  1.35401591e+02]
 [ 1.63746550e+01 -5.47025642e+02 -3.09584687e+02]
 [ 1.56473887e+02 -5.64867565e+02 -9.96291800e+01]
 [ 2.01070367e+02 -5.81268545e+02 -3.94122879e+01]
 [ 2.87926019e+02 -9.71053714e+02 -1.48415416e+02]
 [ 4.97828953e+02 -8.31168999e+02  2.72193944e+02]
 [ 7.59071180e+02  1.50809259e+01  1.20747750e+03]
 [ 3.59568328e+02 -2.71867650e+01  5.50558047e+02]
 [ 2.85067855e+02  9.76232600e-01  4.50148167e+02]
 [ 3.67381795e+02 -5.61341970e+01  5.45396682e+02]
 [ 2.83836430e+02 -2.23898202e+01  4.34097180e+02]
 [ 2.88727908e+02 -7.91557003e+01  4.07440747e+02]
 [ 2.94129458e+02 -1.31875552e+02  3.84045242e+02]
 [ 6.89247090e+02 -6.09301430e+02  7.15595527e+02]
 [ 2.56751139e+02  9.46070305e+02  9.86054611e+02]
 [ 3.94029426e+01  4.00635062e+02  3.09234407e+02]
 [ 1.29520862e+02  3.82552496e+02  4.37967903e+02]
 [ 1.57687519e+02  3.82400289e+02  4.82107056e+02]
 [ 2.16569549e+02  2.26715407e+02  4.78135985e+02]
 [ 2.57613783e+02  1.13572413e+02  4.74498619e+02]
 [ 2.90560992e+02  2.27588553e+02  5.94038984e+02]
 [ 5.20745185e+02  2.81178682e+02  9.92628197e+02]
 [ 1.27186068e+01  9.83020424e+02  6.30240842e+02]
 [-1.73566264e+02  1.27230757e+03  5.17407157e+02]
 [-3.69950960e+02  1.34167610e+03  2.55890439e+02]
 [-2.38560468e+02  5.79505140e+02 -1.06334840e+01]
 [-1.89455773e+02  6.15341028e+02  8.78761088e+01]
 [-1.27604672e+02  5.50791551e+02  1.44181996e+02]
 [-8.79511983e+01  6.09046251e+02  2.42458181e+02]
 [ 2.11725675e+01  4.93389442e+02  3.39428891e+02]
 [-4.84273939e+02  1.06834578e+03 -8.87010667e+01]
 [-8.04425370e+02  1.05032729e+03 -5.99831084e+02]
 [-4.58900972e+02  4.31266754e+02 -4.48746703e+02]
 [-2.83102515e+02  2.88164503e+02 -2.64082009e+02]
 [-3.03688544e+02  3.54697753e+02 -2.54881747e+02]
 [-3.93440740e+02  5.06045851e+02 -2.99437054e+02]
 [-3.37918299e+02  4.87518545e+02 -2.23837360e+02]
 [-3.06826213e+02  5.17912601e+02 -1.56076427e+02]
 [-8.84977088e+02  4.30712175e+02 -1.11230049e+03]
 [-7.10752992e+02  2.72652851e+02 -9.38870171e+02]
 [-3.69980580e+02 -1.32658442e+02 -6.55542789e+02]
 [-3.56417520e+02 -2.43506287e+01 -5.69907007e+02]
 [-4.04532770e+02  1.67080711e+02 -5.29993626e+02]
 [-4.17822556e+02  1.88873909e+02 -5.37333093e+02]
 [-4.19910590e+02  2.60785963e+02 -4.96018590e+02]
 [-4.14180033e+02  2.63478678e+02 -4.85580449e+02]
 [-1.94149615e+02 -4.43568453e+02 -5.73321039e+02]
 [-2.98694323e+02 -1.93948611e+02 -5.82712031e+02]
 [-3.62124855e+02 -5.82341499e+02 -9.25183952e+02]
 [-3.49573416e+02 -6.79752596e+02 -9.65020903e+02]
 [-2.06780853e+02 -7.29512890e+02 -7.71580798e+02]
 [-3.49320412e+01 -6.16285412e+02 -4.33181703e+02]
 [ 1.81633291e+00 -6.03833124e+02 -3.68103509e+02]
 [-6.41062845e+01 -5.60204249e+02 -4.43820782e+02]]
False
Data Array
Numpy all close: True
Numpy array_equal: False

and the v0.2.0 enterprise file: 

ant_1_array parameter value is array, values are not close
parameter _ant_1_array does not match. Left is [ 0  1  2 ... 86 87 87], right is [ 40  41  42 ... 126 127 127]
ant_2_array parameter value is array, values are not close
parameter _ant_2_array does not match. Left is [ 0  0  0 ... 86 86 87], right is [ 40  40  40 ... 126 126 127]
antenna_numbers parameter value is array, values are not close
parameter _antenna_numbers does not match. Left is [ 0  1  2  3  4  5  6  7  8  9 10 11 12 13 14 15 16 17 18 19 20 21 22 23
 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71
 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87], right is [ 40  41  42  43  44  45  46  47  48  49  50  51  52  53  54  55  56  57
  58  59  60  61  62  63  64  65  66  67  68  69  70  71  72  73  74  75
  76  77  78  79  80  81  82  83  84  85  86  87  88  89  90  91  92  93
  94  95  96  97  98  99 100 101 102 103 104 105 106 107 108 109 110 111
 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127]
baseline_array parameter value is array, values are not close
parameter _baseline_array does not match. Left is [ 67585  69633  71681 ... 243799 245847 245848], right is [149545 151593 153641 ... 325759 327807 327808]
history parameter value is a string, values are different
parameter _history does not match. Left is Simulated with pyuvsim version: 0.0.1.  Git origin: https://github.com/H
ERA-Team/pyuvsim.git.  Git hash: cf856ebf3a5554cdde02774e0798ae0a3e599a0
6.  Git branch: reference_sim_changes.  Git description: cf856eb. Source
s from source list: catalog_files/mock_catalog_heratext_2458098.38824015
.txt. Based on config files: obsparam_ref_1.1.yaml, telescope_config/mwa
88_nocore_config.yaml, telescope_config/mwa_nocore_layout.csv Npus = 100
.  Read/written with pyuvdata version: 1.3.1.  Git origin: https://githu
b.com/HERA-Team/pyuvdata.git.  Git hash: 628d570eb16bc20e79fe0fc3db50eb9
75b9fa968.  Git branch: master.  Git description: v1.3-20-g628d570.  Read/written with pyuvdata version: 1.3.3.  Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash: 1ceda98827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git description: v1.3-212-g1ceda98., right is Simulated with pyuvsim version: 0.2.0.  Git origin: git@github.com:HERA-
Team/pyuvsim.  Git hash: 08a3143afb9847879e7a597b49adf01c579aea8e.  Git
branch: HEAD.  Git description: v0.2.0-dirty. Sources from source list:
catalog_files/mock_catalog_heratext_2458098.38824015.txt. Based on confi
g files: ., telescope_config/mwa88_nocore_config.yaml, telescope_config/
mwa_nocore_layout.csv Npus = 20.  Read/written with pyuvdata version: 1.
3.3.  Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash:
1ceda98827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git desc
ription: v1.3-212-g1ceda98.
object_name parameter value is a string, values are different
parameter _object_name does not match. Left is zenith, right is catalog_files/mock_catalog_heratext_2458098.38824015.txt_ra60.8017_dec-30.7671
antenna_positions parameter value is array, values are not close
parameter _antenna_positions does not match. Left is [[ 2.07511610e+00 -3.37901103e+01 -2.18770176e+01]
 [ 5.78635268e+00 -2.50812642e+01 -1.07194608e+01]
 [-6.93618742e-01 -9.70044322e+00 -1.14337893e+01]
 [ 2.64522815e+00 -5.91497079e+00 -3.87651485e+00]
 [ 5.23812456e+00 -1.48055076e-01  3.75977439e+00]
 [-1.53944936e+00  1.59965831e+00 -5.75107119e+00]
 [-7.95103734e+00  8.16080633e+00 -1.17040185e+01]
 [-1.57727817e+01  1.78489228e+01 -1.77418922e+01]
 [ 2.21125604e+01 -1.23360188e+02 -4.53707958e+01]
 [-2.21968897e+01 -1.43128535e+02 -1.26663364e+02]
 [-1.30923959e+02 -2.78468864e+02 -3.76024515e+02]
 [-2.03038537e+01 -3.46449404e+02 -2.45460069e+02]
 [ 1.64216396e+01 -4.01362046e+02 -2.21179681e+02]
 [ 1.17670814e+02 -3.78954064e+02 -4.81014348e+01]
 [ 7.93651578e+01 -2.81950175e+02 -5.04014900e+01]
 [ 1.20477558e+02 -2.71276493e+02  2.15371240e+01]
 [ 1.89559225e+02 -1.94908540e+01  2.85453259e+02]
 [ 7.32416596e+01 -3.03151550e+01  9.30776901e+01]
 [ 2.55982855e+01  1.35888140e+01  4.42209272e+01]
 [ 3.04099871e+01  5.85189404e+00  4.69938674e+01]
 [ 4.12414355e+01 -1.69791673e+01  5.02105126e+01]
 [ 3.42349160e+01 -1.56801092e+01  3.98244514e+01]
 [ 1.79114365e+02 -2.76026669e+02  1.11886384e+02]
 [ 1.40188382e+02 -1.49603837e+02  1.27052880e+02]
 [-1.64642159e+02  3.64237427e+02 -3.18533620e+01]
 [-1.12741249e+02  2.20550434e+02 -4.10164527e+01]
 [ 2.21221535e-01  7.58794539e+01  4.33511911e+01]
 [ 1.39340691e+01  3.39520471e+01  3.86191724e+01]
 [ 2.14892076e+01  2.66182726e+01  4.58649361e+01]
 [ 3.93637818e+01  5.77354733e+01  9.33465303e+01]
 [ 9.61306992e+01  1.70071704e+02  2.52885262e+02]
 [ 7.54476305e+01  1.99287982e+02  2.38187617e+02]
 [ 3.46659261e+02 -3.41968574e+02  3.37535801e+02]
 [ 3.23350194e+02 -3.20926723e+02  3.13366345e+02]
 [ 2.64856016e+02 -4.35855171e+02  1.50170599e+02]
 [ 2.43824331e+01 -5.41102148e+02 -2.94815680e+02]
 [ 1.64481665e+02 -5.58944071e+02 -8.48601722e+01]
 [ 2.09078145e+02 -5.75345051e+02 -2.46432800e+01]
 [ 2.95933797e+02 -9.65130220e+02 -1.33646408e+02]
 [ 5.05836731e+02 -8.25245505e+02  2.86962952e+02]
 [ 7.67078958e+02  2.10044200e+01  1.22224651e+03]
 [ 3.67576106e+02 -2.12632709e+01  5.65327055e+02]
 [ 2.93075633e+02  6.89972674e+00  4.64917174e+02]
 [ 3.75389573e+02 -5.02107029e+01  5.60165690e+02]
 [ 2.91844208e+02 -1.64663261e+01  4.48866188e+02]
 [ 2.96735686e+02 -7.32322061e+01  4.22209755e+02]
 [ 3.02137236e+02 -1.25952058e+02  3.98814250e+02]
 [ 6.97254868e+02 -6.03377936e+02  7.30364534e+02]
 [ 2.64758917e+02  9.51993799e+02  1.00082362e+03]
 [ 4.74107206e+01  4.06558556e+02  3.24003414e+02]
 [ 1.37528640e+02  3.88475991e+02  4.52736911e+02]
 [ 1.65695297e+02  3.88323783e+02  4.96876064e+02]
 [ 2.24577327e+02  2.32638901e+02  4.92904993e+02]
 [ 2.65621561e+02  1.19495907e+02  4.89267627e+02]
 [ 2.98568770e+02  2.33512047e+02  6.08807992e+02]
 [ 5.28752963e+02  2.87102176e+02  1.00739720e+03]
 [ 2.07263848e+01  9.88943918e+02  6.45009850e+02]
 [-1.65558486e+02  1.27823106e+03  5.32176165e+02]
 [-3.61943182e+02  1.34759959e+03  2.70659447e+02]
 [-2.30552690e+02  5.85428634e+02  4.13552387e+00]
 [-1.81447995e+02  6.21264522e+02  1.02645117e+02]
 [-1.19596894e+02  5.56715045e+02  1.58951003e+02]
 [-7.99434202e+01  6.14969745e+02  2.57227189e+02]
 [ 2.91803455e+01  4.99312936e+02  3.54197899e+02]
 [-4.76266161e+02  1.07426928e+03 -7.39320588e+01]
 [-7.96417592e+02  1.05625079e+03 -5.85062076e+02]
 [-4.50893194e+02  4.37190248e+02 -4.33977695e+02]
 [-2.75094737e+02  2.94087998e+02 -2.49313001e+02]
 [-2.95680766e+02  3.60621247e+02 -2.40112739e+02]
 [-3.85432962e+02  5.11969346e+02 -2.84668046e+02]
 [-3.29910521e+02  4.93442039e+02 -2.09068352e+02]
 [-2.98818435e+02  5.23836095e+02 -1.41307419e+02]
 [-8.76969310e+02  4.36635669e+02 -1.09753148e+03]
 [-7.02745214e+02  2.78576346e+02 -9.24101164e+02]
 [-3.61972802e+02 -1.26734948e+02 -6.40773781e+02]
 [-3.48409742e+02 -1.84271346e+01 -5.55137999e+02]
 [-3.96524992e+02  1.73004205e+02 -5.15224619e+02]
 [-4.09814778e+02  1.94797403e+02 -5.22564085e+02]
 [-4.11902812e+02  2.66709457e+02 -4.81249582e+02]
 [-4.06172255e+02  2.69402172e+02 -4.70811441e+02]
 [-1.86141837e+02 -4.37644959e+02 -5.58552031e+02]
 [-2.90686545e+02 -1.88025117e+02 -5.67943024e+02]
 [-3.54117077e+02 -5.76418005e+02 -9.10414945e+02]
 [-3.41565638e+02 -6.73829102e+02 -9.50251895e+02]
 [-1.98773075e+02 -7.23589396e+02 -7.56811790e+02]
 [-2.69242632e+01 -6.10361918e+02 -4.18412695e+02]
 [ 9.82411093e+00 -5.97909629e+02 -3.53334501e+02]
 [-5.60985065e+01 -5.54280755e+02 -4.29051774e+02]], right is [[-5.93266192e+00 -3.97136044e+01 -3.66460254e+01]
 [-2.22142534e+00 -3.10047584e+01 -2.54884686e+01]
 [-8.70139676e+00 -1.56239374e+01 -2.62027971e+01]
 [-5.36254987e+00 -1.18384649e+01 -1.86455227e+01]
 [-2.76965346e+00 -6.07154921e+00 -1.10092334e+01]
 [-9.54722738e+00 -4.32383582e+00 -2.05200790e+01]
 [-1.59588154e+01  2.23731220e+00 -2.64730263e+01]
 [-2.37805597e+01  1.19254286e+01 -3.25109000e+01]
 [ 1.41047824e+01 -1.29283682e+02 -6.01398037e+01]
 [-3.02046678e+01 -1.49052029e+02 -1.41432372e+02]
 [-1.38931737e+02 -2.84392358e+02 -3.90793523e+02]
 [-2.83116317e+01 -3.52372898e+02 -2.60229077e+02]
 [ 8.41386160e+00 -4.07285540e+02 -2.35948689e+02]
 [ 1.09663036e+02 -3.84877558e+02 -6.28704426e+01]
 [ 7.13573798e+01 -2.87873670e+02 -6.51704979e+01]
 [ 1.12469780e+02 -2.77199987e+02  6.76811615e+00]
 [ 1.81551447e+02 -2.54143482e+01  2.70684252e+02]
 [ 6.52338816e+01 -3.62386492e+01  7.83086822e+01]
 [ 1.75905075e+01  7.66531988e+00  2.94519193e+01]
 [ 2.24022090e+01 -7.16000949e-02  3.22248596e+01]
 [ 3.32336575e+01 -2.29026614e+01  3.54415047e+01]
 [ 2.62271379e+01 -2.16036033e+01  2.50554436e+01]
 [ 1.71106587e+02 -2.81950163e+02  9.71173760e+01]
 [ 1.32180604e+02 -1.55527332e+02  1.12283873e+02]
 [-1.72649937e+02  3.58313932e+02 -4.66223699e+01]
 [-1.20749027e+02  2.14626940e+02 -5.57854606e+01]
 [-7.78655649e+00  6.99559598e+01  2.85821833e+01]
 [ 5.92629103e+00  2.80285529e+01  2.38501646e+01]
 [ 1.34814296e+01  2.06947784e+01  3.10959283e+01]
 [ 3.13560038e+01  5.18119792e+01  7.85775225e+01]
 [ 8.81229212e+01  1.64148210e+02  2.38116254e+02]
 [ 6.74398525e+01  1.93364488e+02  2.23418609e+02]
 [ 3.38651483e+02 -3.47892068e+02  3.22766793e+02]
 [ 3.15342416e+02 -3.26850217e+02  2.98597337e+02]
 [ 2.56848238e+02 -4.41778665e+02  1.35401591e+02]
 [ 1.63746550e+01 -5.47025642e+02 -3.09584687e+02]
 [ 1.56473887e+02 -5.64867565e+02 -9.96291800e+01]
 [ 2.01070367e+02 -5.81268545e+02 -3.94122879e+01]
 [ 2.87926019e+02 -9.71053714e+02 -1.48415416e+02]
 [ 4.97828953e+02 -8.31168999e+02  2.72193944e+02]
 [ 7.59071180e+02  1.50809259e+01  1.20747750e+03]
 [ 3.59568328e+02 -2.71867650e+01  5.50558047e+02]
 [ 2.85067855e+02  9.76232600e-01  4.50148167e+02]
 [ 3.67381795e+02 -5.61341970e+01  5.45396682e+02]
 [ 2.83836430e+02 -2.23898202e+01  4.34097180e+02]
 [ 2.88727908e+02 -7.91557003e+01  4.07440747e+02]
 [ 2.94129458e+02 -1.31875552e+02  3.84045242e+02]
 [ 6.89247090e+02 -6.09301430e+02  7.15595527e+02]
 [ 2.56751139e+02  9.46070305e+02  9.86054611e+02]
 [ 3.94029426e+01  4.00635062e+02  3.09234407e+02]
 [ 1.29520862e+02  3.82552496e+02  4.37967903e+02]
 [ 1.57687519e+02  3.82400289e+02  4.82107056e+02]
 [ 2.16569549e+02  2.26715407e+02  4.78135985e+02]
 [ 2.57613783e+02  1.13572413e+02  4.74498619e+02]
 [ 2.90560992e+02  2.27588553e+02  5.94038984e+02]
 [ 5.20745185e+02  2.81178682e+02  9.92628197e+02]
 [ 1.27186068e+01  9.83020424e+02  6.30240842e+02]
 [-1.73566264e+02  1.27230757e+03  5.17407157e+02]
 [-3.69950960e+02  1.34167610e+03  2.55890439e+02]
 [-2.38560468e+02  5.79505140e+02 -1.06334840e+01]
 [-1.89455773e+02  6.15341028e+02  8.78761088e+01]
 [-1.27604672e+02  5.50791551e+02  1.44181996e+02]
 [-8.79511983e+01  6.09046251e+02  2.42458181e+02]
 [ 2.11725675e+01  4.93389442e+02  3.39428891e+02]
 [-4.84273939e+02  1.06834578e+03 -8.87010667e+01]
 [-8.04425370e+02  1.05032729e+03 -5.99831084e+02]
 [-4.58900972e+02  4.31266754e+02 -4.48746703e+02]
 [-2.83102515e+02  2.88164503e+02 -2.64082009e+02]
 [-3.03688544e+02  3.54697753e+02 -2.54881747e+02]
 [-3.93440740e+02  5.06045851e+02 -2.99437054e+02]
 [-3.37918299e+02  4.87518545e+02 -2.23837360e+02]
 [-3.06826213e+02  5.17912601e+02 -1.56076427e+02]
 [-8.84977088e+02  4.30712175e+02 -1.11230049e+03]
 [-7.10752992e+02  2.72652851e+02 -9.38870171e+02]
 [-3.69980580e+02 -1.32658442e+02 -6.55542789e+02]
 [-3.56417520e+02 -2.43506287e+01 -5.69907007e+02]
 [-4.04532770e+02  1.67080711e+02 -5.29993626e+02]
 [-4.17822556e+02  1.88873909e+02 -5.37333093e+02]
 [-4.19910590e+02  2.60785963e+02 -4.96018590e+02]
 [-4.14180033e+02  2.63478678e+02 -4.85580449e+02]
 [-1.94149615e+02 -4.43568453e+02 -5.73321039e+02]
 [-2.98694323e+02 -1.93948611e+02 -5.82712031e+02]
 [-3.62124855e+02 -5.82341499e+02 -9.25183952e+02]
 [-3.49573416e+02 -6.79752596e+02 -9.65020903e+02]
 [-2.06780853e+02 -7.29512890e+02 -7.71580798e+02]
 [-3.49320412e+01 -6.16285412e+02 -4.33181703e+02]
 [ 1.81633291e+00 -6.03833124e+02 -3.68103509e+02]
 [-6.41062845e+01 -5.60204249e+02 -4.43820782e+02]]
False
Data Array
Numpy all close: True
Numpy array_equal: False

summary: Data arrays are "allclose" for reference sim 1.1 but not identical.

mkolopanis commented 5 years ago

Here's another interesting thing, the data arrays for v0.2.0 and v0.1.0 are identical: 

Comparing these two files: v0.1.0//simulation_results/ref_1.1_uniform.uvfits and v0.2.0/simulation_results/ref_1.1_uniform.uvfits
history parameter value is a string, values are different
parameter _history does not match. Left is Simulated with pyuvsim version: 0.1.0.  Git origin: git@github.com:HERA-
Team/pyuvsim.  Git hash: 9475ee15165c6c7f2bcc96b350c2d27eb646e28c.  Git
branch: HEAD.  Git description: v0.1.0-dirty. Sources from source list:
catalog_files/mock_catalog_heratext_2458098.38824015.txt. Based on confi
g files: ., telescope_config/mwa88_nocore_config.yaml, telescope_config/
mwa_nocore_layout.csv Npus = 20.  Read/written with pyuvdata version: 1.
3.3.  Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash:
1ceda98827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git desc
ription: v1.3-212-g1ceda98., right is Simulated with pyuvsim version: 0.2.0.  Git origin: git@github.com:HERA-
Team/pyuvsim.  Git hash: 08a3143afb9847879e7a597b49adf01c579aea8e.  Git
branch: HEAD.  Git description: v0.2.0. Sources from source list: catalo
g_files/mock_catalog_heratext_2458098.38824015.txt. Based on config file
s: ., telescope_config/mwa88_nocore_config.yaml, telescope_config/mwa_no
core_layout.csv Npus = 20.  Read/written with pyuvdata version: 1.3.3.
Git origin: https://github.com/HERA-Team/pyuvdata.git.  Git hash: 1ceda9
8827043424cef97fcb6398ca40e1ccd93c.  Git branch: master.  Git descriptio
n: v1.3-212-g1ceda98.
object_name parameter value is a string, values are different
parameter _object_name does not match. Left is zenith, right is catalog_files/mock_catalog_heratext_2458098.38824015.txt_ra60.8017_dec-30.7671
False
Data Array
Numpy all close: True
Numpy array_equal: True
jpober commented 5 years ago

pyuvsim seems to run on two different architectures. Interesting things could arise with a deeper dive, but this is good for now.