Closed twiecki closed 11 years ago
I know that its failing that why we're adding the dmat cdf
On Mon, Nov 12, 2012 at 5:05 PM, Thomas Wiecki notifications@github.comwrote:
nosetests test_optimization.py..FF...======================================================================FAIL: hddm.tests.test_optimization.test_chisquare_recovery_single_subject_from_true_starting_point----------------------------------------------------------------------Traceback (most recent call last): File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(_self.arg) File "/home/wiecki/working/projects/hddm/hddm/tests/test_optimization.py", line 126, in test_chisquare_recovery_single_subject_from_true_starting_point optimization_recovery_single_subject(repeats=5, seed=1, true_starting_point=True, optimization_method='chisquare') File "/home/wiecki/working/projects/hddm/hddm/tests/test_optimization.py", line 93, in optimization_recovery_single_subject np.testing.assert_allclose(df.values[0], df.values[1], atol=0.1) File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/numpy/testing/utils.py", line 1168, in assert_allclose verbose=verbose, header=header) File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/numpy/testing/utils.py", line 636, in assert_array_compare raise AssertionError(msg)AssertionError: Not equal to tolerance rtol=1e-07, atol=0.1 (mismatch 100.0%) x: array([ 0.66630308, 0.27365502, 0. , 0.5 , 0.75 ,
- , 0.56300107]) y: array([ 0.65926739, 0.27516055, 0.12853521, 0.613678 , 0.86490377, 1.06992727, 0.54477662])-------------------- >> begin captured stdout << ---------------------\ the true parameters **{'v(c3)': 1.0, 'a': 0.5001715622260173, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4160973480326474, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 1903.806592 Iterations: 3 Function evaluations: 221Optimization terminated successfully. Current function value: 1903.806747 Iterations: 5 Function evaluations: 355Warning: Maximum number of function evaluations has been exceeded. a t v(c0) v(c1) v(c2) v(c3)true 0.500 0.416 0.000 0.500 0.750 1.000estimated 0.496 0.417 0.002 0.457 0.832 1.008_ the true parameters {'v(c3)': 1.0, 'a': 1.9121569474977251, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.2505529076859609, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 172.078258 Iterations: 3 Function evaluations: 235Optimization terminated successfully. Current function value: 172.078232 Iterations: 5 Function evaluations: 384Optimization terminated successfully. Current function value: 172.078228 Iterations: 8 Function evaluations: 611 a t v(c0) v(c1) v(c2) v(c3)true 1.912 0.251 0.000 0.500 0.750 1.000estimated 1.911 0.256 0.001 0.495 0.766 0.974** the true parameters _{'v(c3)': 1.0, 'a': 0.6588550480374213, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.38766784309341146, 'v(c0)': 0, 'z': 0.5, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 852.619434 Iterations: 3 Function evaluations: 229Optimization terminated successfully. Current function value: 852.626209 Iterations: 10 Function evaluations: 665Optimization terminated successfully. Current function value: 852.619511 Iterations: 5 Function evaluations: 362 a t v(c0) v(c1) v(c2) v(c3)true 0.659 0.388 0.000 0.500 0.750 1.000estimated 0.666 0.386 -0.001 0.549 0.752 0.932 the true parameters **{'v(c3)': 1.0, 'a': 1.3095831118813606, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4121142876735653, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 324.017378 Iterations: 3 Function evaluations: 235Optimization terminated successfully. Current function value: 324.017387 Iterations: 5 Function evaluations: 373Optimization terminated successfully. Current function value: 324.017380 Iterations: 6 Function evaluations: 451 a t v(c0) v(c1) v(c2) v(c3)true 1.310 0.412 0.000 0.500 0.750 1.000estimated 1.307 0.414 0.025 0.518 0.726 0.993_ the true parameters {'v(c3)': 1.0, 'a': 0.592369877607861, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.35280088557498057, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 1112.505000 Iterations: 3 Function evaluations: 236Warning: Maximum number of function evaluations has been exceeded.Optimization terminated successfully. Current function value: 1112.505000 Iterations: 8 Function evaluations: 587 a t v(c0) v(c1) v(c2) v(c3)true 0.592 0.353 0.00 0.500 0.750 1.00estimated 0.588 0.353 -0.01 0.438 0.786 0.93** the true parameters _{'v(c3)': 1.0, 'a': 1.7204219618387624, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4051326837907725, 'v(c0)': 0, 'z': 0.5986094931105445, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 213.333105 Iterations: 5 Function evaluations: 456Optimization terminated successfully. Current function value: 213.333872 Iterations: 7 Function evaluations: 623Optimization terminated successfully. Current function value: 213.333922 Iterations: 6 Function evaluations: 532 a t v(c0) v(c1) v(c2) v(c3) ztrue 1.72 0.405 0.000 0.500 0.750 1.000 0.599estimated 1.71 0.410 0.028 0.509 0.785 1.037 0.588 the true parameters **{'v(c3)': 1.0, 'a': 0.6663030751135781, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.273655018463263, 'v(c0)': 0, 'z': 0.5630010742790033, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 629.375166 Iterations: 6 Function evaluations: 531Optimization terminated successfully. Current function value: 629.374003 Iterations: 7 Function evaluations: 578Optimization terminated successfully. Current function value: 629.366813 Iterations: 11 Function evaluations: 954 a t v(c0) v(c1) v(c2) v(c3) ztrue 0.666 0.274 0.000 0.500 0.750 1.00 0.563estimated 0.659 0.275 0.129 0.614 0.865 1.07 0.545 --------------------- >> end captured stdout << ---------------------- ======================================================================FAIL: hddm.tests.test_optimization.test_gsquare_recovery_single_subject_from_true_starting_point----------------------------------------------------------------------Traceback (most recent call last): File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(_self.arg) File "/home/wiecki/working/projects/hddm/hddm/tests/test_optimization.py", line 129, in test_gsquare_recovery_single_subject_from_true_starting_point optimization_recovery_single_subject(repeats=5, seed=1, true_starting_point=True, optimization_method='gsquare') File "/home/wiecki/working/projects/hddm/hddm/tests/test_optimization.py", line 93, in optimization_recovery_single_subject np.testing.assert_allclose(df.values[0], df.values[1], atol=0.1) File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/numpy/testing/utils.py", line 1168, in assert_allclose verbose=verbose, header=header) File "/home/wiecki/envs/hddm/local/lib/python2.7/site-packages/numpy/testing/utils.py", line 636, in assert_array_compare raise AssertionError(msg)AssertionError: Not equal to tolerance rtol=1e-07, atol=0.1 (mismatch 100.0%) x: array([ 0.66630308, 0.27365502, 0. , 0.5 , 0.75 ,
- , 0.56300107]) y: array([ 0.66036752, 0.27511103, 0.11856771, 0.62397546, 0.87239892, 1.08069072, 0.54353552])-------------------- >> begin captured stdout << ---------------------* the true parameters {'v(c3)': 1.0, 'a': 0.5001715622260173, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4160973480326474, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 245830.269597 Iterations: 2 Function evaluations: 143Optimization terminated successfully. Current function value: 245826.840369 Iterations: 4 Function evaluations: 281Warning: Maximum number of function evaluations has been exceeded. a t v(c0) v(c1) v(c2) v(c3)true 0.500 0.416 0.000 0.500 0.750 1.000estimated 0.499 0.417 -0.025 0.451 0.813 0.999** the true parameters _{'v(c3)': 1.0, 'a': 1.9121569474977251, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.2505529076859609, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 233182.025709 Iterations: 1 Function evaluations: 68Optimization terminated successfully. Current function value: 233176.772750 Iterations: 5 Function evaluations: 328Optimization terminated successfully. Current function value: 233177.115979 Iterations: 4 Function evaluations: 267 a t v(c0) v(c1) v(c2) v(c3)true 1.912 0.251 0 0.500 0.75 1.000estimated 1.915 0.256 0 0.498 0.77 0.977 the true parameters **{'v(c3)': 1.0, 'a': 0.6588550480374213, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.38766784309341146, 'v(c0)': 0, 'z': 0.5, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 244186.060004 Iterations: 2 Function evaluations: 140Optimization terminated successfully. Current function value: 244184.428892 Iterations: 4 Function evaluations: 282Optimization terminated successfully. Current function value: 244184.435312 Iterations: 5 Function evaluations: 326 a t v(c0) v(c1) v(c2) v(c3)true 0.659 0.388 0.000 0.500 0.750 1.000estimated 0.667 0.386 0.013 0.534 0.744 0.937_ the true parameters {'v(c3)': 1.0, 'a': 1.3095831118813606, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4121142876735653, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 238924.910313 Iterations: 1 Function evaluations: 71Optimization terminated successfully. Current function value: 238921.780183 Iterations: 3 Function evaluations: 213Optimization terminated successfully. Current function value: 238921.567039 Iterations: 5 Function evaluations: 346 a t v(c0) v(c1) v(c2) v(c3)true 1.310 0.412 0.000 0.500 0.750 1.000estimated 1.308 0.414 0.027 0.516 0.728 0.994** the true parameters _{'v(c3)': 1.0, 'a': 0.592369877607861, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.35280088557498057, 'v(c0)': 0, 'z': 0.5, < span class="s">'v(c1)': 0.5}Optimization terminated successfully. Current function value: 244878.185234 Iterations: 1 Function evaluations: 70Warning: Maximum number of function evaluations has been exceeded.Optimization terminated successfully. Current function value: 244872.172495 Iterations: 4 Function evaluations: 278 a t v(c0) v(c1) v(c2) v(c3)true 0.592 0.353 0.000 0.500 0.750 1.000estimated 0.589 0.353 -0.005 0.448 0.777 0.923 the true parameters **{'v(c3)': 1.0, 'a': 1.7204219618387624, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.4051326837907725, 'v(c0)': 0, 'z': 0.5986094931105445, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 228886.405374 Iterations: 3 Function evaluations: 251Optimization terminated successfully. Current function value: 228884.829504 Iterations: 4 Function evaluations: 322Optimization terminated successfully. Current function value: 228883.655281 Iterations: 8 Function evaluations: 646 a t v(c0) v(c1) v(c2) v(c3) ztrue 1.720 0.405 0.000 0.500 0.750 1.000 0.599estimated 1.711 0.410 0.027 0.509 0.785 1.036 0.588**_ the true parameters ***{'v(c3)': 1.0, 'a': 0.6663030751135781, 'sz': 0, 'v(c2)': 0.75, 'sv': 0, 'st': 0, 't': 0.273655018463263, 'v(c0)': 0, 'z': 0.5630010742790033, 'v(c1)': 0.5}Optimization terminated successfully. Current function value: 241663.365866 Iterations: 3 Function evaluations: 244Optimization terminated successfully. Current function value: 241670.396260 Iterations: 4 Function evaluations: 327Optimization terminated successfully. Current function value: 241661.948524 Iterations: 8 Function evaluations: 680 a t v(c0) v(c1) v(c2) v(c3) ztrue 0.666 0.274 0.000 0.500 0.750 1.000 0.563estimated 0.660 0.275 0.119 0.624 0.872 1.081 0.544 --------------------- >> end captured stdout << ---------------------- ----------------------------------------------------------------------Ran 7 tests in 597.239s FAILED (failures=2)
Reply to this email directly or view it on GitHubhttps://github.com/hddm-devs/hddm/issues/14.