search

LLNL / hiop

HPC solver for nonlinear optimization problems
Other
210 stars 42 forks source link

Discusision: Tracking progress of ExaGO with Cusolver-lu #459

Closed abhyshr closed 2 years ago

abhyshr commented 2 years ago

@pelesh

ExaGO version: develop HiOP version: 0.6.0 Machine: Newell

HIOP options:

#dualsUpdateType linear
#dualsInitialization zero

duals_init zero
linsol_mode speculative
linear_solver_sparse cusolver-lu
#linear_solver_sparse ma57

compute_mode hybrid

verbosity_level 10
mu0 1e-1
fixed_var relax
#tolerance 1e-6

scaling_type none
bound_relax_perturb 1e-4

ExaGO output for 9-bus case with HIOP verbosity level 10

bash-4.2$ ./opflow -netfile ../share/exago/datafiles/case9/case9mod.m -opflow_solver HIOPSPARSE
[1650912816.048289] [newell03:10599:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[1650912816.098478] [newell03:10599:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[ExaGO] Creating OPFlow

[Warning] Hiop does not understand option 'dualsUpdateType' and will ignore its value 'linear'.
[Warning] Hiop does not understand option 'dualsInitialization' and will ignore its value 'zero'.
[Warning] Hiop will ignore value 'relax' set for option 'fixed_var' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'cpu' set for option 'compute_mode' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '3' set for option 'verbosity_level' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '0.1' set for option 'mu0' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '1e-08' set for option 'bound_relax_perturb' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'none' set for option 'scaling_type' at runtime since this option is already specified in the option file.
NlpFormulation initialization: using mem_space='default'
[Warning] Detected 1 fixed variables out of a total of 24.
===============
Hiop SOLVER
===============
Using 1 MPI ranks.
---------------
Problem Summary
---------------
Total number of variables: 24
     lower/upper/lower_and_upper bounds: 16 / 16 / 16
Total number of equality constraints: 18
Total number of inequality constraints: 18
     lower/upper/lower_and_upper bounds: 18 / 18 / 18
Using initial point:
x:    =[0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.800000000000000044e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.550000000000000044e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.400000000000000133e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; ];
d:    =[9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 2.340899999999987088e-02 ; 2.340899999999987088e-02 ; 3.204100000000009718e-02 ; 3.204100000000009718e-02 ; 9.900000000000000813e-03 ; 9.900000000000000813e-03 ; 1.092024999999996124e-02 ; 1.092024999999996124e-02 ; ];
yc:   =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
yd:   =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
sxl:  =[1.000000000000000048e-04 ; 1.000999999999999668e-01 ; 1.700099999999999945e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 1.450099999999999945e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 1.300100000000000033e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; 0.000000000000000000e+00 ; 1.000999999999999668e-01 ; ];
sxu:  =[1.000000000000000048e-04 ; 1.001100000000001433e-01 ; 1.700350000000000028e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 1.450300000000000145e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 1.300270000000000037e+00 ; 3.000300000000000189e+00 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; 0.000000000000000000e+00 ; 1.001100000000001433e-01 ; ];
sdl:  =[1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 2.350899999999987028e-02 ; 2.350899999999987028e-02 ; 3.214100000000010005e-02 ; 3.214100000000010005e-02 ; 1.000000000000000021e-02 ; 1.000000000000000021e-02 ; 1.102024999999996063e-02 ; 1.102024999999996063e-02 ; ];
sdu:  =[1.443154399999999882e+01 ; 1.443154399999999882e+01 ; 6.240725000000000300e+00 ; 6.240725000000000300e+00 ; 8.990999999999999659e+00 ; 8.990999999999999659e+00 ; 6.240725000000000300e+00 ; 6.240725000000000300e+00 ; 6.240725000000000300e+00 ; 6.240725000000000300e+00 ; 6.227216000000000307e+00 ; 6.227216000000000307e+00 ; 2.218183999999999934e+00 ; 2.218183999999999934e+00 ; 6.240725000000000300e+00 ; 6.240725000000000300e+00 ; 2.239304750000000066e+00 ; 2.239304750000000066e+00 ; ];
zl:   =[1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; ];
zu:   =[1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; 0.000000000000000000e+00 ; 1.000000000000000000e+00 ; ];
vl:   =[1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; ];
vu:   =[1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; 1.000000000000000000e+00 ; ];
gradx_log_bar grad_f: =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 4.460000000000000000e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 2.755000000000000000e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 3.529999999999999545e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
gradx_log_bar grad_log: =[0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 4.459999991351770404e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 2.754999990490138316e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 3.529999989943690252e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; ];
gradx_log_bar final, with damping: =[0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 4.459999991351770404e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 2.754999990490138316e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 3.529999989943690252e+03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; 0.000000000000000000e+00 ; -9.979033053819641452e-05 ; ];
gradd_log_bar final, with damping: =[-9.993070734496599883e+00 ; -9.993070734496599883e+00 ; -9.983976220711536342e+00 ; -9.983976220711536342e+00 ; -9.988877766655544832e+00 ; -9.988877766655544832e+00 ; -9.983976220711536342e+00 ; -9.983976220711536342e+00 ; -9.983976220711536342e+00 ; -9.983976220711536342e+00 ; -4.237631535695394192e+00 ; -4.237631535695394192e+00 ; -3.066208951713615516e+00 ; -3.066208951713615516e+00 ; -9.983976220711536342e+00 ; -9.983976220711536342e+00 ; -9.029547588039012140e+00 ; -9.029547588039012140e+00 ; ];
log bar obj: 10328
NLP resid [update]: inf norm rx=4.46000000000000000e+03
NLP resid [update]: inf norm rd=0.00000000000000000e+00
NLP resid [update]: inf norm ryc=1.80000000000000004e+00
NLP resid [update]: inf norm ryd=9.89999750000000039e-03
NLP resid [update]: inf norm rxl=9.71445146547011973e-17
NLP resid [update]: inf norm rxu=0.00000000000000000e+00
NLP resid [update]: inf norm rdl=2.85958322993051794e-18
NLP resid [update]: inf norm rdu=1.42247325030098182e-16
NLP resid [update]: inf norm rszl=2.90030000000000010e+00
NLP resid [update]: inf norm rszu=2.90030000000000010e+00
NLP resid [update]: inf norm rsvl=9.00000000000000105e-02
NLP resid [update]: inf norm rsvu=1.43315439999999992e+01
First residual-------------
    rx: =[-0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -4.460000000000000000e+03 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -2.755000000000000000e+03 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -3.529999999999999545e+03 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; -0.000000000000000000e+00 ; ];
    rd: =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
   ryc: =[1.800000000000000044e+00 ; 5.000000000165982783e-05 ; 1.550000000000000044e+00 ; 4.999999999988347099e-05 ; 1.400000000000000133e+00 ; 5.000000000165982783e-05 ; 0.000000000000000000e+00 ; 1.670500000000014751e-01 ; -7.500000000000000000e-01 ; -2.590000000000012292e-01 ; -9.000000000000000222e-01 ; -4.199999999999909361e-02 ; 0.000000000000000000e+00 ; 2.275499999999999190e-01 ; -1.000000000000000000e+00 ; -1.709999999999997078e-01 ; 0.000000000000000000e+00 ; 2.835500000000017451e-01 ; ];
   ryd: =[9.899997500000000394e-03 ; 9.899997500000000394e-03 ; 9.899997500000000394e-03 ; 9.899997500000000394e-03 ; 9.899997500000000394e-03 ; 9.899997500000000394e-03 ; 2.156000000000143045e-03 ; 2.156000000000143045e-03 ; 3.658999999999901914e-03 ; 3.658999999999901914e-03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 4.349749999999932663e-03 ; 4.349749999999932663e-03 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
  rszl: =[9.990000000000000269e-02 ; -9.999999999996123101e-05 ; -1.600099999999999856e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; -1.350099999999999856e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; -1.200099999999999945e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; 0.000000000000000000e+00 ; -9.999999999996123101e-05 ; ];
  rszu: =[9.990000000000000269e-02 ; -1.100000000001377654e-04 ; -1.600349999999999939e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; -1.350300000000000056e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; -1.200269999999999948e+00 ; -2.900300000000000100e+00 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; 0.000000000000000000e+00 ; -1.100000000001377654e-04 ; ];
  rsvl: =[9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 7.649100000000014221e-02 ; 7.649100000000014221e-02 ; 6.785899999999990551e-02 ; 6.785899999999990551e-02 ; 9.000000000000001055e-02 ; 9.000000000000001055e-02 ; 8.897975000000005186e-02 ; 8.897975000000005186e-02 ; ];
  rsvu: =[-1.433154399999999917e+01 ; -1.433154399999999917e+01 ; -6.140725000000000655e+00 ; -6.140725000000000655e+00 ; -8.891000000000000014e+00 ; -8.891000000000000014e+00 ; -6.140725000000000655e+00 ; -6.140725000000000655e+00 ; -6.140725000000000655e+00 ; -6.140725000000000655e+00 ; -6.127216000000000662e+00 ; -6.127216000000000662e+00 ; -2.118183999999999845e+00 ; -2.118183999999999845e+00 ; -6.140725000000000655e+00 ; -6.140725000000000655e+00 ; -2.139304749999999977e+00 ; -2.139304749999999977e+00 ; ];
   rxl: =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 9.714451465470119729e-17 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 9.714451465470119729e-17 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 9.714451465470119729e-17 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
   rxu: =[0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; 0.000000000000000000e+00 ; ];
   rdl: =[6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; -2.859583229930517945e-18 ; -2.859583229930517945e-18 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; 6.098637220230962441e-19 ; ];
   rdu: =[1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; 1.422473250300981817e-16 ; 1.422473250300981817e-16 ; -1.110223024625156540e-16 ; -1.110223024625156540e-16 ; 1.908195823574487804e-17 ; 1.908195823574487804e-17 ; -1.075528555105620399e-16 ; -1.075528555105620399e-16 ; ];
 errors (optim/feasib/complem) nlp    :     4.4600000000000000e+03    1.8000000000000000e+00    1.4431543999999999e+01
 errors (optim/feasib/complem) barrier:    4.4600000000000000e+03    1.8000000000000000e+00    1.4331543999999999e+01
nrmOneDualEqu 0   nrmOneDualBo 68
nlpoverall 4460  nloptim 4460  sd 1  nlpfeas 1.8  nlpcomplem 14.4315  sc 1
  Nlp    errs: pr-infeas:1.80000000000000004e+00   dual-infeas:4.46000000000000000e+03  comp:1.44315439999999988e+01  overall:4.46000000000000000e+03
  LogBar errs: pr-infeas:1.80000000000000004e+00   dual-infeas:4.46000000000000000e+03  comp:1.43315439999999992e+01  overall:4.46000000000000000e+03
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
   0  1.0318125e+04 1.800e+00  4.460e+03  -1.00  0.000e+00  0.000e+00  -(-)
Iter[0] logbarObj=1.03279586565656537e+04 (mu= 1.00000e-01)
linsys: delta_w= 0.00000e+00 delta_c= 0.00000e+00 (ic 0)
KKT_SPARSE_XDYcYd linsys: alloc [STRUMPACK-LU] size 78 (36 cons) (hybrid)
Numeric klu factorization succesful! 
CUSOLVER: Glu 
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e-04 delta_c= 0.00000e+00 (ic 1)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e-02 delta_c= 0.00000e+00 (ic 2)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+00 delta_c= 0.00000e+00 (ic 3)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+02 delta_c= 0.00000e+00 (ic 4)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+04 delta_c= 0.00000e+00 (ic 5)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+06 delta_c= 0.00000e+00 (ic 6)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+08 delta_c= 0.00000e+00 (ic 7)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+10 delta_c= 0.00000e+00 (ic 8)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+12 delta_c= 0.00000e+00 (ic 9)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+14 delta_c= 0.00000e+00 (ic 10)
linsys negative eigs mismatch: has 0 expected 36.
[Error] Reached max number (10) of refactorization within an outer iteration.
[Warning] Requesting additional accuracy and stability from the KKT linear system at iteration 0 (safe mode ON) [1]
linsys: delta_w= 0.00000e+00 delta_c= 0.00000e+00 (ic 0)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 3.33333e+15 delta_c= 0.00000e+00 (ic 1)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 2.66667e+16 delta_c= 0.00000e+00 (ic 2)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 2.13333e+17 delta_c= 0.00000e+00 (ic 3)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.70667e+18 delta_c= 0.00000e+00 (ic 4)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.36533e+19 delta_c= 0.00000e+00 (ic 5)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e-04 delta_c= 5.62341e-09 (ic 6)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e-02 delta_c= 5.62341e-09 (ic 7)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+00 delta_c= 5.62341e-09 (ic 8)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+02 delta_c= 5.62341e-09 (ic 9)
linsys negative eigs mismatch: has 0 expected 36.
linsys: delta_w= 1.00000e+04 delta_c= 5.62341e-09 (ic 10)
linsys negative eigs mismatch: has 0 expected 36.
[Error] Reached max number (10) of refactorization within an outer iteration.
Unrecoverable error in step computation (factorization) [1]. Will exit here.
[ExaGO] Finalizing opflow application.
nychiang commented 2 years ago

I remember cusolver cannot provide inertia information. Therefore we should use inertia-free algorithm with cusolver. That is, setting fact_acceptor to inertia_free.

abhyshr commented 2 years ago

Adding fact_acceptor option works and I get a converged solution.

When I am ignoring the line flow constraints (no inequality constraints), I see the following error..

bash-4.2$ ./opflow -netfile ../share/exago/datafiles/case_ACTIVSg200.m -opflow_solver HIOPSPARSE -opflow_ignore_lineflow_constraints
[1650982257.646833] [newell03:13614:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[1650982257.703807] [newell03:13614:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[ExaGO] Creating OPFlow

[Warning] Hiop does not understand option 'dualsUpdateType' and will ignore its value 'linear'.
[Warning] Hiop does not understand option 'dualsInitialization' and will ignore its value 'zero'.
[Warning] Hiop will ignore value 'relax' set for option 'fixed_var' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'cpu' set for option 'compute_mode' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '3' set for option 'verbosity_level' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '0.1' set for option 'mu0' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '1e-08' set for option 'bound_relax_perturb' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'none' set for option 'scaling_type' at runtime since this option is already specified in the option file.
[Warning] Detected 1 fixed variables out of a total of 476.
===============
Hiop SOLVER
===============
Using 1 MPI ranks.
---------------
Problem Summary
---------------
Total number of variables: 476
     lower/upper/lower_and_upper bounds: 277 / 277 / 277
Total number of equality constraints: 400
Total number of inequality constraints: 0
     lower/upper/lower_and_upper bounds: 0 / 0 / 0
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
   0  4.0417248e+04 3.699e+00  2.322e+03  -1.00  0.000e+00  0.000e+00  -(-)
opflow: /people/abhy245/software/hiop-v0.6.0/hiop/src/LinAlg/hiopVectorPar.cpp:206: virtual void hiop::hiopVectorPar::startingAtCopyFromStartingAt(int, const hiop::hiopVector&, int): Assertion `(start_idx_src>=0 && start_idx_src<v.n_local_) || v.n_local_==0' failed.
[newell03:13614] *** Process received signal ***
[newell03:13614] Signal: Aborted (6)
[newell03:13614] Signal code:  (-6)
[newell03:13614] [ 0] [0x7fff900904d8]
[newell03:13614] [ 1] /usr/lib64/libc.so.6(abort+0x2b4)[0x7fff86c21f94]
[newell03:13614] [ 2] /usr/lib64/libc.so.6(+0x355d4)[0x7fff86c155d4]
[newell03:13614] [ 3] /usr/lib64/libc.so.6(__assert_fail+0x64)[0x7fff86c156c4]
[newell03:13614] [ 4] ./opflow[0x102d5830]
[newell03:13614] [ 5] ./opflow[0x102803d8]
[newell03:13614] [ 6] ./opflow[0x10280c40]
[newell03:13614] [ 7] ./opflow[0x102edbac]
[newell03:13614] [ 8] ./opflow[0x1027b724]
[newell03:13614] [ 9] ./opflow[0x1026bb2c]
[newell03:13614] [10] ./opflow[0x102675e0]
[newell03:13614] [11] ./opflow[0x101774d0]
[newell03:13614] [12] ./opflow[0x100a43e8]
[newell03:13614] [13] ./opflow[0x1007581c]
[newell03:13614] [14] /usr/lib64/libc.so.6(+0x25100)[0x7fff86c05100]
[newell03:13614] [15] /usr/lib64/libc.so.6(__libc_start_main+0xc4)[0x7fff86c052f4]
[newell03:13614] *** End of error message ***
^CAborted (core dumped)
nychiang commented 2 years ago

Try the latest develop branch. I recently fixed this bug.

pelesh commented 2 years ago

Try the latest develop branch. I recently fixed this bug.

Is the fix in v0.6.1? Could you point to the issue or PR?

CC @kswirydo

nychiang commented 2 years ago

454

It is not included in v0.6.1

It seems the assertion error Shri showed comes from Line 206 in src/LinAlg/hiopVectorPar.cpp, see here: https://github.com/LLNL/hiop/pull/454/files#diff-0a2808a0f83ed6c6c0f4c9203bed17166728d751ab4d26f094fe7e41f228504fR455

abhyshr commented 2 years ago

I ran several cases with cusolver and here are the results. This is with ExaGO develop + HIOP develop branch on Newell

case200

bash-4.2$ mpiexec -n 1 ./opflow -netfile ../share/exago/datafiles/case9/case9mod.m -opflow_solver HIOPSPARSE -opflow_initialization FROMFILE -opflow_ignore_lineflow_constraints -netfile $EXAGO_DIR/datafiles/case_ACTIVSg200.m
[1651068909.164029] [newell03:28534:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[1651068909.215303] [newell03:28534:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[ExaGO] Creating OPFlow

[Warning] Hiop does not understand option 'dualsUpdateType' and will ignore its value 'linear'.
[Warning] Hiop does not understand option 'dualsInitialization' and will ignore its value 'zero'.
[Warning] Hiop will ignore value 'relax' set for option 'fixed_var' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'cpu' set for option 'compute_mode' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '3' set for option 'verbosity_level' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '0.1' set for option 'mu0' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '1e-08' set for option 'bound_relax_perturb' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'none' set for option 'scaling_type' at runtime since this option is already specified in the option file.
[Warning] Detected 1 fixed variables out of a total of 476.
===============
Hiop SOLVER
===============
Using 1 MPI ranks.
---------------
Problem Summary
---------------
Total number of variables: 476
     lower/upper/lower_and_upper bounds: 277 / 277 / 277
Total number of equality constraints: 400
Total number of inequality constraints: 0
     lower/upper/lower_and_upper bounds: 0 / 0 / 0
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
   0  2.7744770e+04 1.533e-02  2.321e+03  -1.00  0.000e+00  0.000e+00  -(-)
   1  2.7649213e+04 1.532e-02  2.258e+03  -1.00  4.035e-02  7.181e-04  1(s)
   2  2.7602073e+04 1.492e-02  1.034e+03  -1.00  7.676e-01  2.627e-02  1(s)
   3  2.7574878e+04 5.260e-03  2.575e+02  -1.00  1.000e+00  6.223e-01  1(s)
   4  2.7562943e+04 7.364e-04  6.503e+00  -1.00  1.000e+00  1.000e+00  1(s)
   5  2.7563304e+04 2.779e-04  1.622e-01  -1.00  1.000e+00  1.000e+00  1(s)
   6  2.7555920e+04 5.970e-03  2.883e-01  -2.55  8.400e-01  1.000e+00  1(s)
   7  2.7553264e+04 5.826e-03  5.452e-01  -2.55  9.301e-01  5.995e-01  1(s)
   8  2.7553244e+04 5.436e-03  7.867e+01  -2.55  1.000e+00  6.690e-02  1(s)
   9  2.7553026e+04 1.695e-04  2.900e-02  -2.55  1.000e+00  1.000e+00  1(s)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  10  2.7552977e+04 3.739e-05  2.468e+00  -3.82  9.552e-01  8.440e-01  1(s)
  11  2.7552974e+04 2.734e-06  3.329e-04  -3.82  1.000e+00  1.000e+00  1(s)
  12  2.7552967e+04 1.047e-06  1.122e-01  -5.73  8.995e-01  9.811e-01  1(h)
  13  2.7552967e+04 3.174e-07  3.074e-05  -5.73  1.000e+00  1.000e+00  1(f)
  14  2.7552967e+04 8.428e-08  8.160e-06  -5.73  1.000e+00  1.000e+00  1(h)
  15  2.7552967e+04 2.664e-08  2.609e-06  -7.00  1.000e+00  1.000e+00  1(h)
  16  2.7552967e+04 5.011e-09  4.856e-07  -7.00  1.000e+00  1.000e+00  1(h)
Successfull termination.
Total time 0.461 sec 
Hiop internal time:     total 0.461 sec     avg iter 0.029 sec 
    internal total std dev across ranks 0.000 percent
Fcn/deriv time:     total=0.028 sec  ( obj=0.000 grad=0.000 cons=0.002 Jac=0.009 Hess=0.017) 
    Fcn/deriv total std dev across ranks 0.000 percent
Fcn/deriv #: obj 18 grad 18 eq cons 19 ineq cons 19 eq Jac 18 ineq Jac 18
Total KKT time 0.426 sec 
    update init 0.000 sec    update linsys 0.002 sec    fact 0.019 sec 
    solve rhs-manip 0.001 sec   inner solve 0.061 sec   resid 0.005 sec   IR 8.500 iter 

[ExaGO] Finalizing opflow application.

case2k

bash-4.2$ mpiexec -n 1 ./opflow -netfile ../share/exago/datafiles/case9/case9mod.m -opflow_solver HIOPSPARSE -opflow_initialization FROMFILE -opflow_ignore_lineflow_constraints -netfile $EXAGO_DIR/datafiles/case_ACTIVSg2000.m
[1651068857.754394] [newell03:28509:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[1651068857.822418] [newell03:28509:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[ExaGO] Creating OPFlow

[Warning] Hiop does not understand option 'dualsUpdateType' and will ignore its value 'linear'.
[Warning] Hiop does not understand option 'dualsInitialization' and will ignore its value 'zero'.
[Warning] Hiop will ignore value 'relax' set for option 'fixed_var' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'cpu' set for option 'compute_mode' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '3' set for option 'verbosity_level' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '0.1' set for option 'mu0' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '1e-08' set for option 'bound_relax_perturb' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'none' set for option 'scaling_type' at runtime since this option is already specified in the option file.
[Warning] Detected 54 fixed variables out of a total of 4864.
===============
Hiop SOLVER
===============
Using 1 MPI ranks.
---------------
Problem Summary
---------------
Total number of variables: 4864
     lower/upper/lower_and_upper bounds: 2865 / 2865 / 2865
Total number of equality constraints: 4000
Total number of inequality constraints: 0
     lower/upper/lower_and_upper bounds: 0 / 0 / 0
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
   0  1.2574191e+06 5.632e-02  2.979e+03  -1.00  0.000e+00  0.000e+00  -(-)
   1  1.2550718e+06 5.601e-02  2.976e+03  -1.00  8.557e-04  7.439e-04  1(s)
   2  1.2529340e+06 5.548e-02  2.972e+03  -1.00  7.703e-04  1.365e-03  1(s)
   3  1.2517840e+06 5.537e-02  2.966e+03  -1.00  3.488e-03  1.948e-03  1(s)
   4  1.2506209e+06 5.312e-02  2.952e+03  -1.00  3.405e-03  4.994e-03  1(s)
   5  1.2489166e+06 4.877e-02  2.929e+03  -1.00  2.549e-03  7.655e-03  1(s)
   6  1.2479228e+06 4.823e-02  2.916e+03  -1.00  6.148e-03  4.630e-03  1(s)
   7  1.2467536e+06 4.761e-02  2.898e+03  -1.00  7.018e-03  5.915e-03  1(s)
   8  1.2447489e+06 4.604e-02  2.867e+03  -1.00  8.312e-03  1.087e-02  1(s)
   9  1.2440163e+06 4.561e-02  2.851e+03  -1.00  1.128e-02  5.131e-03  1(s)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  10  1.2425179e+06 4.408e-02  2.818e+03  -1.00  9.717e-03  1.191e-02  1(s)
  11  1.2416777e+06 4.335e-02  2.787e+03  -1.00  1.602e-02  8.263e-03  1(s)
  12  1.2393722e+06 4.413e-02  2.725e+03  -1.00  1.831e-02  2.440e-02  1(s)
  13  1.2385144e+06 4.419e-02  2.676e+03  -1.00  3.139e-02  1.056e-02  1(s)
  14  1.2354912e+06 4.591e-02  2.565e+03  -1.00  4.207e-02  4.145e-02  1(s)
  15  1.2344248e+06 4.506e-02  2.466e+03  -1.00  7.272e-02  2.003e-02  1(s)
  16  1.2325258e+06 4.317e-02  2.309e+03  -1.00  1.031e-01  4.384e-02  1(s)
  17  1.2310530e+06 4.116e-02  2.216e+03  -1.00  2.657e-02  4.665e-02  1(s)
  18  1.2299596e+06 3.917e-02  1.969e+03  -1.00  2.430e-01  4.834e-02  1(s)
  19  1.2293855e+06 3.729e-02  1.867e+03  -1.00  6.206e-02  4.785e-02  1(s)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  20  1.2290237e+06 3.582e-02  1.763e+03  -1.00  9.838e-02  3.950e-02  1(s)
  21  1.2283375e+06 3.232e-02  1.614e+03  -1.00  4.666e-02  9.763e-02  1(s)
  22  1.2280217e+06 2.985e-02  1.455e+03  -1.00  1.584e-01  7.662e-02  1(s)
  23  1.2277808e+06 2.652e-02  1.284e+03  -1.00  1.343e-01  1.116e-01  1(s)
  24  1.2276996e+06 2.405e-02  1.804e+03  -1.00  5.609e-01  9.322e-02  1(s)
  25  1.2277171e+06 1.911e-02  1.541e+03  -1.00  3.772e-01  2.050e-01  1(s)
  26  1.2278433e+06 1.533e-02  1.408e+03  -1.00  1.000e+00  1.981e-01  1(s)
  27  1.2282090e+06 1.112e-02  7.952e+02  -1.00  7.380e-01  4.389e-01  1(s)
  28  1.2283676e+06 8.470e-03  7.509e+02  -1.00  1.000e+00  2.433e-01  1(s)
  29  1.2286216e+06 4.448e-03  3.972e+02  -1.00  1.000e+00  4.840e-01  1(s)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  30  1.2289035e+06 1.886e-04  9.445e+00  -1.00  1.000e+00  1.000e+00  1(s)
  31  1.2289041e+06 7.246e-08  1.243e-04  -1.00  1.000e+00  1.000e+00  1(s)
  32  1.2288836e+06 1.299e-04  6.518e+02  -2.55  7.839e-01  3.610e-01  1(f)
  33  1.2288694e+06 1.982e-04  7.459e+02  -2.55  8.101e-01  3.938e-01  1(s)
  34  1.2288524e+06 2.841e-04  1.776e+02  -2.55  8.782e-01  7.957e-01  1(s)
  35  1.2288486e+06 4.953e-05  1.005e-02  -2.55  1.000e+00  1.000e+00  1(s)
  36  1.2288473e+06 2.123e-05  1.538e+01  -3.82  8.093e-01  8.940e-01  1(s)
  37  1.2288471e+06 7.790e-06  9.074e-04  -3.82  1.000e+00  1.000e+00  1(s)
  38  1.2288470e+06 2.951e-06  9.038e+00  -5.73  7.267e-01  9.252e-01  1(f)
  39  1.2288470e+06 7.031e-07  2.349e+00  -5.73  9.026e-01  1.000e+00  1(f)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  40  1.2288470e+06 1.990e-07  1.490e-05  -5.73  1.000e+00  1.000e+00  1(h)
  41  1.2288470e+06 7.038e-08  4.819e-01  -7.00  7.822e-01  1.000e+00  1(h)
  42  1.2288470e+06 1.222e-08  9.871e-07  -7.00  1.000e+00  1.000e+00  1(h)
Successfull termination.
Total time 3.003 sec 
Hiop internal time:     total 2.945 sec     avg iter 0.070 sec 
    internal total std dev across ranks 0.000 percent
Fcn/deriv time:     total=0.848 sec  ( obj=0.002 grad=0.002 cons=0.066 Jac=0.259 Hess=0.519) 
    Fcn/deriv total std dev across ranks 0.000 percent
Fcn/deriv #: obj 44 grad 44 eq cons 45 ineq cons 45 eq Jac 44 ineq Jac 44
Total KKT time 2.010 sec 
    update init 0.005 sec    update linsys 0.060 sec    fact 0.359 sec 
    solve rhs-manip 0.019 sec   inner solve 1.695 sec   resid 0.119 sec   IR 21.500 iter 

[ExaGO] Finalizing opflow application.

case10k

bash-4.2$ mpiexec -n 1 ./opflow -netfile ../share/exago/datafiles/case9/case9mod.m -opflow_solver HIOPSPARSE -opflow_initialization FROMFILE -opflow_ignore_lineflow_constraints -netfile $EXAGO_DIR/datafiles/case_ACTIVSg10k.m
[1651068608.021404] [newell03:28481:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[1651068608.077130] [newell03:28481:0]    ucp_context.c:671  UCX  WARN  network devices 'mlx5_1:1','mlx5_3:1' are not available, please use one or more of: 'enP48p1s0f0'(tcp), 'enP48p1s0f1'(tcp)
[ExaGO] Creating OPFlow

[Warning] Hiop does not understand option 'dualsUpdateType' and will ignore its value 'linear'.
[Warning] Hiop does not understand option 'dualsInitialization' and will ignore its value 'zero'.
[Warning] Hiop will ignore value 'relax' set for option 'fixed_var' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'cpu' set for option 'compute_mode' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '3' set for option 'verbosity_level' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '0.1' set for option 'mu0' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value '1e-08' set for option 'bound_relax_perturb' at runtime since this option is already specified in the option file.
[Warning] Hiop will ignore value 'none' set for option 'scaling_type' at runtime since this option is already specified in the option file.
[Warning] Detected 1113 fixed variables out of a total of 23874.
===============
Hiop SOLVER
===============
Using 1 MPI ranks.
---------------
Problem Summary
---------------
Total number of variables: 23874
     lower/upper/lower_and_upper bounds: 13875 / 13875 / 13875
Total number of equality constraints: 20000
Total number of inequality constraints: 0
     lower/upper/lower_and_upper bounds: 0 / 0 / 0
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
   0  2.4876525e+06 5.434e-02  3.197e+03  -1.00  0.000e+00  0.000e+00  -(-)
[Warning] solve compressed high absolute resid norm (= 2.87449e-08)
   1  2.4847547e+06 5.431e-02  3.195e+03  -1.00  1.669e-03  6.370e-04  1(s)
[Warning] solve compressed high absolute resid norm (= 4.81749e-08)
   2  2.4836641e+06 5.423e-02  3.190e+03  -1.00  1.353e-03  1.377e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 4.97958e-08)
   3  2.4824632e+06 5.407e-02  3.180e+03  -1.00  4.615e-03  2.917e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 3.31546e-08)
   4  2.4819527e+06 5.386e-02  3.160e+03  -1.00  1.066e-02  3.862e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 4.11433e-08)
   5  2.4813524e+06 5.321e-02  3.130e+03  -1.00  6.674e-03  1.113e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.73189e-08)
   6  2.4812548e+06 5.303e-02  3.106e+03  -1.00  1.424e-02  3.400e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 2.67297e-08)
   7  2.4807763e+06 5.141e-02  3.051e+03  -1.00  1.119e-02  2.188e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 3.42905e-08)
   8  2.4804972e+06 4.993e-02  3.007e+03  -1.00  5.861e-03  1.956e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.00027e-08)
   9  2.4802529e+06 4.807e-02  2.937e+03  -1.00  2.383e-02  2.338e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.34821e-08)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  10  2.4801163e+06 4.654e-02  2.860e+03  -1.00  3.350e-02  2.122e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.84381e-08)
  11  2.4800865e+06 4.600e-02  2.805e+03  -1.00  3.557e-02  9.631e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 3.57919e-08)
  12  2.4800127e+06 4.281e-02  2.689e+03  -1.00  4.319e-02  4.011e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.37362e-08)
  13  2.4800213e+06 4.235e-02  2.655e+03  -1.00  1.821e-02  9.549e-03  1(s)
[Warning] solve compressed high absolute resid norm (= 4.24568e-08)
  14  2.4800576e+06 4.061e-02  2.549e+03  -1.00  5.499e-02  3.066e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 3.39071e-08)
  15  2.4801379e+06 3.936e-02  2.433e+03  -1.00  7.483e-02  2.879e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 4.93917e-08)
  16  2.4802655e+06 3.808e-02  2.298e+03  -1.00  9.519e-02  3.386e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 1.87231e-08)
  17  2.4805639e+06 3.566e-02  2.093e+03  -1.00  1.240e-01  7.171e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 3.41226e-08)
  18  2.4807526e+06 3.423e-02  2.575e+03  -1.00  3.206e-01  4.197e-02  1(s)
[Warning] solve compressed high absolute resid norm (= 2.01140e-08)
  19  2.4815803e+06 2.893e-02  2.994e+03  -1.00  4.034e-01  1.754e-01  1(s)
[Warning] solve compressed high absolute resid norm (= 1.88501e-08)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  20  2.4833747e+06 1.788e-02  2.156e+03  -1.00  6.125e-01  4.281e-01  1(s)
[Warning] solve compressed high absolute resid norm (= 1.09050e-08)
  21  2.4853867e+06 5.023e-03  6.829e+02  -1.00  1.000e+00  7.900e-01  1(s)
  22  2.4859397e+06 4.883e-04  1.217e+01  -1.00  1.000e+00  1.000e+00  1(s)
  23  2.4859394e+06 3.453e-05  7.664e-03  -1.00  1.000e+00  1.000e+00  1(s)
  24  2.4858627e+06 1.671e-04  1.091e+03  -2.55  5.364e-01  2.214e-01  1(f)
  25  2.4858151e+06 2.278e-04  1.434e+03  -2.55  4.661e-01  1.761e-01  1(s)
  26  2.4857223e+06 6.496e-04  8.139e+02  -2.55  3.956e-01  4.166e-01  1(s)
  27  2.4857074e+06 5.873e-04  1.127e+03  -2.55  7.971e-01  1.259e-01  1(s)
  28  2.4856807e+06 5.250e-04  7.875e+02  -2.55  3.808e-01  2.719e-01  1(s)
  29  2.4856476e+06 5.069e-04  4.108e+02  -2.55  5.665e-01  4.862e-01  1(s)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  30  2.4856309e+06 3.292e-04  2.248e+02  -2.55  1.000e+00  5.175e-01  1(s)
  31  2.4856201e+06 1.349e-04  1.073e+02  -2.55  1.000e+00  7.242e-01  1(s)
  32  2.4856163e+06 1.051e-05  2.136e-03  -2.55  1.000e+00  1.000e+00  1(s)
  33  2.4856111e+06 1.901e-05  9.331e+01  -3.82  8.741e-01  6.465e-01  1(f)
  34  2.4856084e+06 8.835e-06  1.721e+01  -3.82  1.000e+00  9.229e-01  1(s)
  35  2.4856082e+06 6.909e-07  3.880e-04  -3.82  1.000e+00  1.000e+00  1(f)
  36  2.4856078e+06 6.769e-07  4.167e+00  -5.73  8.456e-01  9.364e-01  1(f)
  37  2.4856078e+06 1.732e-07  3.212e+00  -5.73  7.828e-01  1.000e+00  1(f)
  38  2.4856078e+06 3.527e-08  1.568e-05  -5.73  1.000e+00  1.000e+00  1(h)
  39  2.4856078e+06 1.814e-08  6.106e-01  -7.00  8.316e-01  1.000e+00  1(f)
iter    objective     inf_pr     inf_du   lg(mu)  alpha_du   alpha_pr linesrch
  40  2.4856078e+06 2.533e-09  9.944e-07  -7.00  1.000e+00  1.000e+00  1(h)
Successfull termination.
Total time 9.210 sec 
Hiop internal time:     total 7.008 sec     avg iter 0.175 sec 
    internal total std dev across ranks 0.000 percent
Fcn/deriv time:     total=3.407 sec  ( obj=0.019 grad=0.012 cons=0.296 Jac=1.029 Hess=2.051) 
    Fcn/deriv total std dev across ranks 0.000 percent
Fcn/deriv #: obj 42 grad 42 eq cons 43 ineq cons 43 eq Jac 42 ineq Jac 42
Total KKT time 5.123 sec 
    update init 0.022 sec    update linsys 0.302 sec    fact 1.187 sec 
    solve rhs-manip 0.088 sec   inner solve 2.963 sec   resid 0.578 sec   IR 20.500 iter

Let me know if you need more/any other info.

cnpetra commented 2 years ago

seems a fix has been found. feel free to reopen