Mittelmann CPU
| set | device | problems | Ipopt | master | ||||
|---|---|---|---|---|---|---|---|---|
| solved | SGM (s) | SSGM | solved | SGM (s) | SSGM | |||
| Mittelmann | CPU | 47/47 | 43 | 126.14 | 1 | 43 | 109.43 | 0.877 |
Outcomes
| solver | solved | acceptable | time limit | iteration limit | other failure | not run yet |
|---|---|---|---|---|---|---|
| Ipopt | 43 | 0 | 0 | 4 | 0 | 0 |
| master | 43 | 0 | 0 | 3 | 1 | 0 |
Solved by problem size
| solver | small | medium | large |
|---|---|---|---|
| Ipopt | 9/9 | 14/15 | 20/23 |
| master | 8/9 | 14/15 | 21/23 |
Performance profiles
Over the 47 instances that all of them have a result for. A curve gives the share of them solved within a factor of the best.
Ipoptmaster
Wall time
Iterations
Time breakdown
| solver | total (s) | linear solver | evaluations | initialization | other |
|---|---|---|---|---|---|
| master | 18945.6 | 79.5% | 14.3% | 1.4% | 4.8% |
Instances
nv, nc: variables, constraints. st: ok solved, a solved to the acceptable level, t time limit, i iteration limit, f other failure; click it for the solver log. it: iterations. inf: infeasibility. nfac, nsol: factorizations, linear solves. nf, ng, nc, nj, nh: evaluations of the objective, gradient, constraints, Jacobian, Hessian.
| instance | nv | nc | Ipopt | master | ||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | |||
| NARX_CFy | 43973 | 48256 | ok | 421 | 1000.253 | 0.00859789 | 7.6e-09 | 0 | 0 | 442 | 422 | 442 | 422 | 421 | ok | 821 | 1487.460 | 0.00859478 | 1.8e-09 | 2047 | 2483 | 3985 | 821 | 3985 | 823 | 820 |
| WM_CFy | 8711 | 12850 | ok | 524 | 1607.193 | 1.22158 | 2.9e-11 | 0 | 0 | 541 | 525 | 541 | 525 | 524 | ok | 159 | 690.992 | 1.23125 | 2.7e-10 | 398 | 420 | 192 | 160 | 192 | 160 | 159 |
| arki0003 | 1872 | 2138 | ok | 289 | 4.617 | -3795.2 | 7.6e-09 | 0 | 0 | 301 | 289 | 301 | 292 | 289 | i | 3000 | 22.485 | -3795.2 | 5.6e-03 | 3324 | 5548 | 30903 | 3001 | 30917 | 3005 | 3000 |
| arki0009 | 6220 | 5924 | ok | 319 | 27.237 | 207097 | 3.8e-10 | 0 | 0 | 348 | 315 | 348 | 321 | 319 | ok | 288 | 11.825 | 207097 | 6.0e-10 | 290 | 410 | 293 | 289 | 293 | 290 | 288 |
| bearing_400 | 160000 | 0 | ok | 16 | 14.617 | -0.15468 | 0.0e+00 | 0 | 0 | 17 | 17 | 0 | 0 | 16 | ok | 16 | 7.865 | -0.15468 | 0.0e+00 | 17 | 20 | 17 | 17 | 17 | 17 | 16 |
| camshape_6400 | 6400 | 19197 | ok | 87 | 12.444 | 4.44838 | 3.7e-12 | 0 | 0 | 93 | 88 | 93 | 88 | 87 | ok | 88 | 5.574 | 4.44838 | 4.4e-12 | 89 | 91 | 106 | 89 | 106 | 89 | 88 |
| clnlbeam | 59999 | 40000 | i | 3000 | 1071.681 | 345.619 | 9.1e-08 | 0 | 0 | 3017 | 3000 | 3017 | 3002 | 3000 | f | 10 | 5.703 | 350.004 | 1.0e-12 | 38 | 202 | 10 | 10 | 10 | 11 | 10 |
| cont5_1_l | 90600 | 90300 | ok | 16 | 58.532 | 2.72097 | 9.8e-10 | 0 | 0 | 17 | 17 | 17 | 17 | 16 | ok | 16 | 52.303 | 2.72097 | 1.0e-09 | 20 | 109 | 17 | 17 | 17 | 17 | 16 |
| cont5_2_1_l | 90600 | 90300 | ok | 41 | 129.702 | 0.000662766 | 3.2e-14 | 0 | 0 | 42 | 42 | 42 | 42 | 41 | ok | 42 | 86.950 | 0.000662747 | 3.9e-14 | 49 | 280 | 62 | 43 | 62 | 43 | 42 |
| cont5_2_2_l | 90600 | 90300 | ok | 45 | 158.954 | 0.000519998 | 2.9e-09 | 0 | 0 | 46 | 46 | 46 | 46 | 45 | ok | 56 | 120.234 | 0.000519997 | 4.0e-09 | 76 | 387 | 70 | 57 | 70 | 57 | 56 |
| cont5_2_3_l | 90600 | 90300 | ok | 52 | 196.640 | 0.000520783 | 3.6e-10 | 0 | 0 | 53 | 53 | 53 | 53 | 52 | ok | 57 | 132.143 | 0.000520783 | 7.3e-10 | 79 | 436 | 58 | 58 | 58 | 58 | 57 |
| cont5_2_4_l | 90600 | 90300 | ok | 16 | 184.119 | 0.0663713 | 6.0e-09 | 0 | 0 | 17 | 17 | 17 | 17 | 16 | ok | 12 | 217.104 | 0.0663714 | 3.0e-09 | 17 | 129 | 13 | 13 | 13 | 13 | 12 |
| corkscrw | 44997 | 35000 | ok | 384 | 153.303 | 98.096 | 2.8e-09 | 0 | 0 | 420 | 365 | 420 | 390 | 384 | ok | 130 | 39.735 | 98.096 | 2.1e-09 | 145 | 241 | 158 | 131 | 158 | 138 | 130 |
| dirichlet120 | 53881 | 241 | ok | 56 | 269.283 | 0.0350361 | 2.4e-10 | 0 | 0 | 71 | 57 | 71 | 57 | 56 | ok | 56 | 199.267 | 0.0350361 | 2.4e-10 | 119 | 65 | 68 | 57 | 68 | 57 | 56 |
| dtoc1nd | 5960 | 3725 | ok | 8 | 5.814 | 136.456 | 7.2e-10 | 0 | 0 | 14 | 9 | 14 | 9 | 8 | ok | 8 | 2.376 | 136.456 | 7.2e-10 | 12 | 20 | 11 | 9 | 11 | 9 | 8 |
| dtoc2 | 64950 | 38970 | ok | 5 | 155.374 | 2.8633 | 2.8e-16 | 0 | 0 | 6 | 6 | 6 | 6 | 5 | ok | 5 | 53.471 | 2.8633 | 2.8e-16 | 11 | 9 | 6 | 6 | 6 | 6 | 5 |
| elec_400 | 1200 | 400 | ok | 126 | 86.488 | 75583.1 | 2.4e-10 | 0 | 0 | 208 | 127 | 208 | 127 | 126 | ok | 144 | 66.109 | 75583.2 | 1.7e-09 | 355 | 152 | 230 | 145 | 230 | 145 | 144 |
| ex1_160 | 50562 | 25281 | ok | 10 | 5.104 | 0.0638967 | 5.0e-10 | 0 | 0 | 11 | 11 | 11 | 11 | 10 | ok | 10 | 6.896 | 0.0638967 | 5.0e-10 | 11 | 13 | 11 | 11 | 11 | 11 | 10 |
| ex1_320 | 203522 | 101761 | ok | 9 | 38.598 | 0.0654351 | 3.0e-10 | 0 | 0 | 10 | 10 | 10 | 10 | 9 | ok | 9 | 19.424 | 0.0654351 | 3.0e-10 | 10 | 14 | 10 | 10 | 10 | 10 | 9 |
| ex4_2_160 | 51198 | 25917 | ok | 21 | 6.455 | 3.64612 | 2.7e-11 | 0 | 0 | 22 | 22 | 22 | 22 | 21 | ok | 21 | 7.449 | 3.64612 | 2.7e-11 | 22 | 44 | 22 | 22 | 22 | 22 | 21 |
| ex4_2_320 | 204798 | 103037 | ok | 17 | 33.804 | 3.63917 | 2.1e-11 | 0 | 0 | 18 | 18 | 18 | 18 | 17 | ok | 17 | 16.605 | 3.63917 | 2.3e-11 | 18 | 43 | 18 | 18 | 18 | 18 | 17 |
| ex8_2_2 | 7510 | 1943 | ok | 67 | 1.431 | -552.666 | 2.2e-12 | 0 | 0 | 68 | 68 | 68 | 68 | 67 | ok | 68 | 0.568 | -552.666 | 1.4e-13 | 69 | 70 | 78 | 69 | 78 | 69 | 68 |
| ex8_2_3 | 15636 | 3155 | ok | 71 | 2.501 | -3731.08 | 6.3e-12 | 0 | 0 | 72 | 72 | 72 | 72 | 71 | ok | 72 | 1.126 | -3731.08 | 2.3e-12 | 73 | 75 | 82 | 73 | 82 | 73 | 72 |
| gasoil_3200 | 32001 | 31998 | ok | 14 | 289.538 | 0.0052366 | 2.4e-12 | 0 | 0 | 36 | 15 | 36 | 15 | 14 | ok | 595 | 6890.377 | 0.0052366 | 2.1e-12 | 647 | 2339 | 6541 | 596 | 6609 | 598 | 595 |
| henon120 | 32401 | 241 | ok | 266 | 377.533 | 133.295 | 1.4e-07 | 0 | 0 | 280 | 267 | 284 | 267 | 266 | ok | 294 | 271.920 | 133.295 | 2.2e-10 | 698 | 316 | 424 | 295 | 424 | 296 | 294 |
| lane_emden120 | 57721 | 241 | ok | 84 | 510.380 | 9.34025 | 9.8e-09 | 0 | 0 | 86 | 85 | 88 | 85 | 84 | ok | 76 | 243.570 | 9.34025 | 9.7e-09 | 172 | 80 | 79 | 77 | 79 | 77 | 76 |
| marine_1600 | 38415 | 38392 | ok | 13 | 19.713 | 1.97465e+07 | 3.1e-12 | 0 | 0 | 17 | 14 | 17 | 14 | 13 | ok | 14 | 10.522 | 1.97465e+07 | 3.1e-12 | 15 | 35 | 18 | 15 | 18 | 15 | 14 |
| nql180 | 129601 | 130080 | ok | 29 | 2016.257 | -0.927721 | 1.3e-03 | 0 | 0 | 31 | 30 | 31 | 30 | 29 | ok | 28 | 1149.518 | -0.919966 | 4.4e-16 | 66 | 29 | 29 | 29 | 29 | 29 | 28 |
| optmass | 60006 | 50005 | ok | 28 | 51.444 | -0.120404 | 2.6e-01 | 0 | 0 | 29 | 29 | 29 | 29 | 28 | ok | 31 | 19.992 | -0.120404 | 7.8e-15 | 45 | 37 | 33 | 32 | 33 | 32 | 31 |
| pinene_3200 | 64000 | 63995 | ok | 13 | 16.572 | 19.8722 | 1.3e-14 | 0 | 0 | 14 | 14 | 14 | 14 | 13 | ok | 11 | 10.449 | 19.8722 | 1.3e-13 | 12 | 53 | 12 | 12 | 12 | 12 | 11 |
| qcqp1000-1nc | 1000 | 154 | ok | 180 | 52.798 | -2.66289e+07 | 4.8e-07 | 0 | 0 | 198 | 181 | 198 | 182 | 180 | ok | 173 | 19.808 | -2.66289e+07 | 3.1e-09 | 242 | 234 | 280 | 174 | 282 | 175 | 173 |
| qcqp1000-2c | 1000 | 5107 | ok | 100 | 39.195 | 738127 | 2.9e-09 | 0 | 0 | 353 | 101 | 353 | 101 | 100 | ok | 89 | 23.181 | 738127 | 2.5e-09 | 90 | 274 | 324 | 90 | 324 | 90 | 89 |
| qcqp1000-2nc | 1000 | 5107 | ok | 293 | 86.751 | 93279.1 | 6.4e-09 | 0 | 0 | 301 | 171 | 301 | 295 | 293 | ok | 142 | 33.024 | 93279.1 | 3.9e-09 | 185 | 218 | 166 | 143 | 166 | 145 | 142 |
| qcqp1500-1c | 1500 | 10508 | ok | 99 | 183.923 | 3.88298e+06 | 7.1e-09 | 0 | 0 | 408 | 100 | 408 | 100 | 99 | ok | 92 | 119.681 | 3.88298e+06 | 8.2e-09 | 93 | 229 | 377 | 93 | 377 | 93 | 92 |
| qcqp1500-1nc | 1500 | 10508 | ok | 2751 | 4951.383 | 4.77925e+06 | 5.8e-09 | 0 | 0 | 3015 | 2746 | 3015 | 2753 | 2751 | ok | 1354 | 2058.726 | 4.77838e+06 | 7.5e-09 | 3157 | 2744 | 1584 | 1355 | 1586 | 1356 | 1354 |
| qcqp500-3c | 500 | 120 | ok | 329 | 307.174 | -1.17336e+07 | 8.8e-08 | 0 | 0 | 3019 | 330 | 3019 | 330 | 329 | i | 3000 | 1472.731 | -1.55763e+06 | 3.0e+01 | 3010 | 7962 | 53631 | 3001 | 53631 | 3002 | 3000 |
| qcqp500-3nc | 500 | 120 | ok | 131 | 111.760 | -2.12353e+07 | 2.6e-08 | 0 | 0 | 141 | 120 | 141 | 133 | 131 | ok | 130 | 34.582 | -2.12353e+07 | 9.1e-09 | 265 | 246 | 246 | 131 | 250 | 134 | 130 |
| qcqp750-2c | 750 | 138 | ok | 71 | 146.310 | -1.59333e+07 | 1.8e-06 | 0 | 0 | 137 | 54 | 158 | 73 | 71 | ok | 701 | 941.735 | -1.59333e+07 | 9.8e-09 | 710 | 1563 | 9263 | 702 | 9263 | 703 | 701 |
| qcqp750-2nc | 750 | 138 | ok | 127 | 357.866 | -2.1619e+07 | 2.1e-08 | 0 | 0 | 429 | 116 | 500 | 131 | 127 | ok | 137 | 104.844 | -2.1619e+07 | 7.5e-09 | 243 | 229 | 186 | 138 | 206 | 140 | 137 |
| qssp180 | 196024 | 130141 | ok | 24 | 50.784 | -6.63945 | 8.3e-02 | 0 | 0 | 25 | 25 | 26 | 25 | 24 | ok | 28 | 114.632 | -6.63945 | 2.5e-11 | 29 | 36 | 30 | 29 | 30 | 29 | 28 |
| robot_1600 | 14399 | 9601 | ok | 35 | 6.278 | 9.14092 | 8.5e-16 | 0 | 0 | 43 | 36 | 43 | 36 | 35 | ok | 36 | 2.223 | 9.14092 | 8.9e-13 | 42 | 94 | 44 | 37 | 44 | 37 | 36 |
| robot_a | 1001 | 52013 | i | 3000 | 1062.573 | 8.65351 | 1.2e+00 | 0 | 0 | 3002 | 3001 | 36477 | 3001 | 3000 | ok | 2307 | 516.533 | 1.0432 | 3.0e-10 | 3708 | 4583 | 23061 | 2308 | 23061 | 2323 | 2307 |
| robot_b | 1001 | 52013 | i | 3000 | 1097.659 | 15.2596 | 1.1e+03 | 0 | 0 | 3002 | 3001 | 33595 | 3001 | 3000 | ok | 2901 | 820.498 | 2.3331 | 4.8e-09 | 5477 | 5280 | 25676 | 2902 | 29841 | 2919 | 2901 |
| robot_c | 1001 | 52013 | i | 3000 | 921.660 | 29.0105 | 2.5e+01 | 0 | 0 | 3332 | 3001 | 34117 | 3001 | 3000 | i | 3000 | 777.085 | 11.5656 | 1.1e+00 | 7567 | 6099 | 36253 | 3001 | 36253 | 3001 | 3000 |
| rocket_12800 | 51201 | 38400 | ok | 30 | 23.161 | 1.01279 | 2.2e-16 | 0 | 0 | 31 | 31 | 31 | 31 | 30 | ok | 30 | 11.982 | 1.01279 | 5.8e-15 | 35 | 38 | 38 | 31 | 38 | 31 | 30 |
| steering_12800 | 64000 | 51201 | ok | 23 | 49.247 | 0.554571 | 7.1e-15 | 0 | 0 | 25 | 24 | 25 | 24 | 23 | ok | 23 | 30.114 | 0.554571 | 7.1e-15 | 29 | 117 | 25 | 24 | 25 | 24 | 23 |
| svanberg | 50000 | 50000 | ok | 34 | 25.943 | 83623.8 | 5.3e-09 | 0 | 0 | 35 | 35 | 58 | 35 | 34 | ok | 34 | 14.244 | 83623.8 | 5.3e-09 | 52 | 48 | 53 | 35 | 53 | 35 | 34 |