Mittelmann CUDA
| set | device | problems | Ipopt | master | current | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| solved | SGM (s) | SSGM | solved | SGM (s) | SSGM | solved | SGM (s) | SSGM | |||
| Mittelmann | CUDA | 47/47 | 39 | 89.67 | 1 | 36 | 31.36 | 0.415 | 35 | 32.90 | 0.43 |
Outcomes
| solver | solved | acceptable | time limit | iteration limit | other failure | not run yet |
|---|---|---|---|---|---|---|
| Ipopt | 39 | 0 | 8 | 0 | 0 | 0 |
| master | 36 | 0 | 0 | 10 | 1 | 0 |
| current | 35 | 0 | 1 | 10 | 1 | 0 |
Solved by problem size
| solver | small | medium | large |
|---|---|---|---|
| Ipopt | 9/9 | 11/15 | 19/23 |
| master | 8/9 | 10/15 | 18/23 |
| current | 7/9 | 9/15 | 19/23 |
Performance profiles
Over the 47 instances that all of them have a result for. A curve gives the share of them solved within a factor of the best.
Ipoptmastercurrent
Wall time
Iterations
Time breakdown
| solver | total (s) | linear solver | evaluations | initialization | other |
|---|---|---|---|---|---|
| master | 2300.5 | 80.2% | 4.0% | 2.4% | 13.5% |
| current | 2673.9 | 131.4% | 4.0% | 1.8% | -37.2% |
Result files: Intel R Xeon R Gold 6148 CPU 2.40GHz, Quadro RTX 6000
Instances
nv, nc: variables, constraints. st: ok solved, a solved to the acceptable level, t time limit, i iteration limit, f other failure; click it for the solver log. it: iterations. inf: infeasibility. nfac, nsol: factorizations, linear solves. nf, ng, nc, nj, nh: evaluations of the objective, gradient, constraints, Jacobian, Hessian.
| instance | nv | nc | Ipopt | master | current | |||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | |||
| NARX_CFy | 43973 | 48256 | t | 421 | 600.000 | 0.00859789 | 7.6e-09 | 0 | 0 | 442 | 422 | 442 | 422 | 421 | ok | 1095 | 40.810 | 0.00837651 | 2.6e-11 | 2738 | 2718 | 5412 | 1096 | 5412 | 1096 | 1095 | ok | 1106 | 41.631 | 0.00840347 | 1.8e-09 | 2764 | 2626 | 5651 | 1107 | 5651 | 1107 | 1106 |
| WM_CFy | 8711 | 12850 | t | 524 | 600.000 | 1.22158 | 2.9e-11 | 0 | 0 | 541 | 525 | 541 | 525 | 524 | ok | 534 | 84.652 | 1.25746 | 1.2e-10 | 1345 | 1051 | 929 | 535 | 929 | 535 | 534 | f | 0 | NaN | NaN | NaN | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| arki0003 | 1872 | 2138 | ok | 289 | 4.617 | -3795.2 | 7.6e-09 | 0 | 0 | 301 | 289 | 301 | 292 | 289 | ok | 2270 | 22.837 | -3795.2 | 4.3e-09 | 5596 | 13491 | 3703 | 2271 | 3787 | 2295 | 2270 | i | 3000 | 38.220 | -3795.18 | 1.5e-07 | 7316 | 12223 | 17676 | 2998 | 17758 | 3106 | 2997 |
| arki0009 | 6220 | 5924 | ok | 319 | 27.237 | 207097 | 3.8e-10 | 0 | 0 | 348 | 315 | 348 | 321 | 319 | i | 3000 | 110.324 | 207097 | 1.5e-10 | 7001 | 21072 | 3351 | 3001 | 3422 | 3033 | 3000 | i | 3000 | 108.955 | 207097 | 1.2e-11 | 6991 | 20619 | 3332 | 3001 | 3405 | 3037 | 3000 |
| bearing_400 | 160000 | 0 | ok | 16 | 14.617 | -0.15468 | 0.0e+00 | 0 | 0 | 17 | 17 | 0 | 0 | 16 | ok | 16 | 1.581 | -0.15468 | 0.0e+00 | 16 | 19 | 17 | 17 | 17 | 17 | 16 | ok | 16 | 1.285 | -0.15468 | 0.0e+00 | 16 | 19 | 17 | 17 | 17 | 17 | 16 |
| camshape_6400 | 6400 | 19197 | ok | 87 | 12.444 | 4.44838 | 3.7e-12 | 0 | 0 | 93 | 88 | 93 | 88 | 87 | ok | 87 | 0.490 | 4.44838 | 3.4e-12 | 87 | 155 | 105 | 88 | 105 | 88 | 87 | ok | 87 | 0.566 | 4.44838 | 3.4e-12 | 87 | 156 | 105 | 88 | 105 | 88 | 87 |
| clnlbeam | 59999 | 40000 | t | 3000 | 600.000 | 345.619 | 9.1e-08 | 0 | 0 | 3017 | 3000 | 3017 | 3002 | 3000 | i | 3000 | 40.003 | 347.744 | 8.0e-11 | 7558 | 5792 | 14745 | 3001 | 14745 | 3009 | 3000 | i | 3000 | 37.538 | 347.711 | 1.8e-09 | 7558 | 5841 | 14202 | 3001 | 14202 | 3006 | 3000 |
| cont5_1_l | 90600 | 90300 | ok | 16 | 58.532 | 2.72097 | 9.8e-10 | 0 | 0 | 17 | 17 | 17 | 17 | 16 | i | 3000 | 280.096 | 2.72098 | 6.0e-14 | 7587 | 45634 | 3092 | 3001 | 3092 | 3002 | 3000 | i | 3000 | 277.513 | 2.72098 | 8.4e-14 | 7587 | 45613 | 3086 | 3001 | 3086 | 3001 | 3000 |
| cont5_2_1_l | 90600 | 90300 | ok | 41 | 129.702 | 0.000662766 | 3.2e-14 | 0 | 0 | 42 | 42 | 42 | 42 | 41 | i | 3000 | 266.273 | 0.00345956 | 2.4e-14 | 7586 | 44456 | 3413 | 3001 | 3413 | 3001 | 3000 | i | 3000 | 278.234 | 0.00415549 | 2.4e-14 | 7584 | 44483 | 3399 | 3000 | 3399 | 3001 | 2999 |
| cont5_2_2_l | 90600 | 90300 | ok | 45 | 158.954 | 0.000519998 | 2.9e-09 | 0 | 0 | 46 | 46 | 46 | 46 | 45 | i | 3000 | 263.307 | 0.0025 | 7.4e-10 | 7586 | 44283 | 3442 | 3001 | 3442 | 3001 | 3000 | i | 3000 | 266.319 | 0.00228016 | 6.6e-11 | 7584 | 44407 | 3502 | 3000 | 3502 | 3001 | 2999 |
| cont5_2_3_l | 90600 | 90300 | ok | 52 | 196.640 | 0.000520783 | 3.6e-10 | 0 | 0 | 53 | 53 | 53 | 53 | 52 | i | 3000 | 279.702 | 0.00381179 | 1.5e-10 | 7586 | 45543 | 3215 | 3001 | 3215 | 3002 | 3000 | i | 3000 | 267.168 | 0.00417389 | 9.0e-10 | 7585 | 45450 | 3188 | 3001 | 3188 | 3003 | 3000 |
| cont5_2_4_l | 90600 | 90300 | ok | 16 | 184.119 | 0.0663713 | 6.0e-09 | 0 | 0 | 17 | 17 | 17 | 17 | 16 | ok | 121 | 12.010 | 0.0663713 | 2.8e-10 | 303 | 1643 | 123 | 122 | 123 | 122 | 121 | ok | 112 | 10.826 | 0.0663713 | 1.4e-09 | 280 | 1571 | 114 | 113 | 114 | 113 | 112 |
| corkscrw | 44997 | 35000 | ok | 384 | 153.303 | 98.096 | 2.8e-09 | 0 | 0 | 420 | 365 | 420 | 390 | 384 | ok | 737 | 9.580 | 98.096 | 4.2e-10 | 1191 | 5855 | 792 | 738 | 796 | 753 | 737 | ok | 772 | 13.174 | 98.096 | 3.3e-09 | 1685 | 8483 | 810 | 773 | 812 | 785 | 772 |
| dirichlet120 | 53881 | 241 | ok | 56 | 269.283 | 0.0350361 | 2.4e-10 | 0 | 0 | 71 | 57 | 71 | 57 | 56 | ok | 53 | 73.847 | 0.0350361 | 2.3e-10 | 118 | 96 | 57 | 54 | 57 | 54 | 53 | ok | 53 | 72.643 | 0.0350361 | 2.3e-10 | 118 | 96 | 57 | 54 | 57 | 54 | 53 |
| dtoc1nd | 5960 | 3725 | ok | 8 | 5.814 | 136.456 | 7.2e-10 | 0 | 0 | 14 | 9 | 14 | 9 | 8 | ok | 10 | 0.366 | 136.456 | 5.5e-15 | 18 | 27 | 13 | 11 | 13 | 11 | 10 | ok | 10 | 0.436 | 136.456 | 5.4e-15 | 18 | 26 | 13 | 11 | 13 | 11 | 10 |
| dtoc2 | 64950 | 38970 | ok | 5 | 155.374 | 2.8633 | 2.8e-16 | 0 | 0 | 6 | 6 | 6 | 6 | 5 | ok | 20 | 1.503 | 2.8623 | 1.3e-12 | 51 | 121 | 23 | 21 | 23 | 21 | 20 | ok | 10 | 1.031 | 2.8623 | 1.0e-11 | 25 | 34 | 12 | 11 | 12 | 11 | 10 |
| elec_400 | 1200 | 400 | ok | 126 | 86.488 | 75583.1 | 2.4e-10 | 0 | 0 | 208 | 127 | 208 | 127 | 126 | ok | 319 | 6.791 | 75583.4 | 1.4e-11 | 764 | 850 | 863 | 319 | 863 | 324 | 318 | ok | 162 | 3.534 | 75583.6 | 3.0e-09 | 397 | 352 | 240 | 163 | 240 | 163 | 162 |
| ex1_160 | 50562 | 25281 | ok | 10 | 5.104 | 0.0638967 | 5.0e-10 | 0 | 0 | 11 | 11 | 11 | 11 | 10 | ok | 17 | 0.616 | 0.063872 | 3.7e-15 | 17 | 32 | 27 | 18 | 27 | 18 | 17 | ok | 17 | 0.618 | 0.063872 | 3.7e-15 | 17 | 33 | 27 | 18 | 27 | 18 | 17 |
| ex1_320 | 203522 | 101761 | ok | 9 | 38.598 | 0.0654351 | 3.0e-10 | 0 | 0 | 10 | 10 | 10 | 10 | 9 | ok | 10 | 2.228 | 0.0654877 | 5.7e-10 | 10 | 20 | 11 | 11 | 11 | 11 | 10 | ok | 10 | 2.197 | 0.0654877 | 5.7e-10 | 10 | 20 | 11 | 11 | 11 | 11 | 10 |
| ex4_2_160 | 51198 | 25917 | ok | 21 | 6.455 | 3.64612 | 2.7e-11 | 0 | 0 | 22 | 22 | 22 | 22 | 21 | ok | 27 | 0.795 | 3.646 | 6.4e-12 | 27 | 58 | 43 | 28 | 43 | 28 | 27 | ok | 24 | 0.768 | 3.646 | 1.7e-10 | 24 | 51 | 29 | 25 | 29 | 25 | 24 |
| ex4_2_320 | 204798 | 103037 | ok | 17 | 33.804 | 3.63917 | 2.1e-11 | 0 | 0 | 18 | 18 | 18 | 18 | 17 | ok | 21 | 2.568 | 3.63875 | 1.0e-11 | 21 | 44 | 25 | 22 | 25 | 22 | 21 | ok | 22 | 2.638 | 3.6387 | 6.5e-12 | 22 | 47 | 27 | 23 | 27 | 23 | 22 |
| ex8_2_2 | 7510 | 1943 | ok | 67 | 1.431 | -552.666 | 2.2e-12 | 0 | 0 | 68 | 68 | 68 | 68 | 67 | ok | 67 | 0.406 | -552.666 | 1.4e-13 | 67 | 72 | 77 | 68 | 77 | 68 | 67 | ok | 67 | 0.454 | -552.666 | 1.4e-13 | 67 | 71 | 77 | 68 | 77 | 68 | 67 |
| ex8_2_3 | 15636 | 3155 | ok | 71 | 2.501 | -3731.08 | 6.3e-12 | 0 | 0 | 72 | 72 | 72 | 72 | 71 | ok | 72 | 0.535 | -3731.08 | 2.3e-12 | 72 | 79 | 82 | 73 | 82 | 73 | 72 | ok | 72 | 0.589 | -3731.08 | 2.3e-12 | 72 | 79 | 82 | 73 | 82 | 73 | 72 |
| gasoil_3200 | 32001 | 31998 | ok | 14 | 289.538 | 0.0052366 | 2.4e-12 | 0 | 0 | 36 | 15 | 36 | 15 | 14 | ok | 54 | 3.182 | 0.00523643 | 7.3e-15 | 126 | 962 | 230 | 55 | 230 | 55 | 54 | ok | 20 | 1.241 | 0.00523643 | 2.2e-09 | 46 | 283 | 91 | 21 | 91 | 21 | 20 |
| henon120 | 32401 | 241 | ok | 266 | 377.533 | 133.295 | 1.4e-07 | 0 | 0 | 280 | 267 | 284 | 267 | 266 | ok | 278 | 81.859 | 133.295 | 2.1e-11 | 651 | 356 | 358 | 279 | 358 | 280 | 278 | ok | 278 | 79.050 | 133.295 | 1.4e-11 | 651 | 356 | 358 | 279 | 358 | 280 | 278 |
| lane_emden120 | 57721 | 241 | ok | 84 | 510.380 | 9.34025 | 9.8e-09 | 0 | 0 | 86 | 85 | 88 | 85 | 84 | ok | 138 | 258.076 | 9.34025 | 9.7e-09 | 333 | 286 | 150 | 139 | 150 | 140 | 138 | ok | 138 | 256.515 | 9.34025 | 9.7e-09 | 333 | 286 | 150 | 139 | 150 | 140 | 138 |
| marine_1600 | 38415 | 38392 | ok | 13 | 19.713 | 1.97465e+07 | 3.1e-12 | 0 | 0 | 17 | 14 | 17 | 14 | 13 | ok | 22 | 0.587 | 1.97465e+07 | 3.3e-12 | 36 | 102 | 24 | 23 | 24 | 23 | 22 | ok | 20 | 0.526 | 1.97465e+07 | 2.8e-12 | 36 | 82 | 22 | 21 | 22 | 21 | 20 |
| nql180 | 129601 | 130080 | t | 29 | 600.000 | -0.927721 | 1.3e-03 | 0 | 0 | 31 | 30 | 31 | 30 | 29 | ok | 188 | 17.104 | -0.92797 | 3.2e-09 | 364 | 878 | 562 | 189 | 562 | 194 | 188 | ok | 165 | 16.246 | -0.928031 | 6.3e-09 | 354 | 797 | 398 | 166 | 429 | 169 | 165 |
| optmass | 60006 | 50005 | ok | 28 | 51.444 | -0.120404 | 2.6e-01 | 0 | 0 | 29 | 29 | 29 | 29 | 28 | ok | 46 | 0.586 | -0.120477 | 1.8e-10 | 90 | 109 | 58 | 47 | 58 | 47 | 46 | ok | 46 | 0.582 | -0.120477 | 1.8e-10 | 90 | 111 | 58 | 47 | 58 | 47 | 46 |
| pinene_3200 | 64000 | 63995 | ok | 13 | 16.572 | 19.8722 | 1.3e-14 | 0 | 0 | 14 | 14 | 14 | 14 | 13 | ok | 16 | 0.750 | 19.8693 | 1.4e-14 | 23 | 33 | 18 | 17 | 18 | 17 | 16 | ok | 17 | 0.757 | 19.8693 | 1.4e-14 | 24 | 34 | 19 | 18 | 19 | 18 | 17 |
| qcqp1000-1nc | 1000 | 154 | ok | 180 | 52.798 | -2.66289e+07 | 4.8e-07 | 0 | 0 | 198 | 181 | 198 | 182 | 180 | ok | 312 | 4.367 | -2.66289e+07 | 2.9e-09 | 502 | 960 | 350 | 313 | 429 | 317 | 312 | ok | 227 | 2.909 | -2.66289e+07 | 5.5e-09 | 347 | 671 | 257 | 228 | 257 | 230 | 227 |
| qcqp1000-2c | 1000 | 5107 | ok | 100 | 39.195 | 738127 | 2.9e-09 | 0 | 0 | 353 | 101 | 353 | 101 | 100 | ok | 73 | 1.120 | 738127 | 4.4e-11 | 73 | 416 | 291 | 74 | 291 | 74 | 73 | ok | 73 | 1.244 | 738127 | 2.9e-11 | 73 | 422 | 293 | 74 | 293 | 74 | 73 |
| qcqp1000-2nc | 1000 | 5107 | ok | 293 | 86.751 | 93279.1 | 6.4e-09 | 0 | 0 | 301 | 171 | 301 | 295 | 293 | ok | 392 | 5.177 | 93279.1 | 4.8e-10 | 495 | 1998 | 406 | 393 | 406 | 396 | 392 | ok | 391 | 5.466 | 93279.1 | 4.9e-10 | 488 | 1931 | 405 | 392 | 405 | 395 | 391 |
| qcqp1500-1c | 1500 | 10508 | ok | 99 | 183.923 | 3.88298e+06 | 7.1e-09 | 0 | 0 | 408 | 100 | 408 | 100 | 99 | ok | 76 | 2.267 | 3.88298e+06 | 8.7e-11 | 76 | 337 | 340 | 77 | 340 | 77 | 76 | ok | 76 | 2.290 | 3.88298e+06 | 1.2e-10 | 76 | 343 | 342 | 77 | 342 | 77 | 76 |
| qcqp1500-1nc | 1500 | 10508 | t | 2751 | 600.000 | 4.77925e+06 | 5.8e-09 | 0 | 0 | 3015 | 2746 | 3015 | 2753 | 2751 | i | 3000 | 87.963 | 4.77984e+06 | 1.7e-02 | 5851 | 8586 | 3266 | 3001 | 3266 | 3007 | 3000 | i | 3000 | 91.390 | 4.79316e+06 | 5.9e-02 | 6286 | 8059 | 3082 | 3001 | 3082 | 3014 | 3000 |
| qcqp500-3c | 500 | 120 | ok | 329 | 307.174 | -1.17336e+07 | 8.8e-08 | 0 | 0 | 3019 | 330 | 3019 | 330 | 329 | ok | 55 | 2.118 | -1.17336e+07 | 2.3e-10 | 87 | 242 | 186 | 56 | 204 | 57 | 55 | ok | 59 | 2.128 | -1.17336e+07 | 3.5e-10 | 93 | 263 | 190 | 60 | 208 | 61 | 59 |
| qcqp500-3nc | 500 | 120 | ok | 131 | 111.760 | -2.12353e+07 | 2.6e-08 | 0 | 0 | 141 | 120 | 141 | 133 | 131 | ok | 152 | 4.803 | -2.12353e+07 | 9.9e-10 | 257 | 923 | 167 | 152 | 180 | 155 | 152 | ok | 95 | 3.256 | -2.12353e+07 | 1.3e-09 | 149 | 693 | 103 | 95 | 116 | 98 | 95 |
| qcqp750-2c | 750 | 138 | ok | 71 | 146.310 | -1.59333e+07 | 1.8e-06 | 0 | 0 | 137 | 54 | 158 | 73 | 71 | ok | 53 | 5.585 | -1.59333e+07 | 3.5e-10 | 73 | 351 | 101 | 54 | 101 | 54 | 53 | ok | 54 | 5.074 | -1.59333e+07 | 5.8e-10 | 75 | 368 | 102 | 55 | 102 | 55 | 54 |
| qcqp750-2nc | 750 | 138 | ok | 127 | 357.866 | -2.1619e+07 | 2.1e-08 | 0 | 0 | 429 | 116 | 500 | 131 | 127 | ok | 388 | 22.806 | -2.1619e+07 | 2.7e-09 | 597 | 1726 | 467 | 386 | 583 | 396 | 388 | ok | 311 | 18.177 | -2.1619e+07 | 1.9e-09 | 447 | 1336 | 352 | 309 | 429 | 316 | 311 |
| qssp180 | 196024 | 130141 | ok | 24 | 50.784 | -6.63945 | 8.3e-02 | 0 | 0 | 25 | 25 | 26 | 25 | 24 | f | 185 | 150.361 | -6.62259 | 5.7e-10 | 431 | 939 | 235 | 186 | 265 | 190 | 185 | t | 3000 | 600.000 | -6.54587 | 3.5e-04 | 5453 | 16076 | 3514 | 3001 | 26446 | 3015 | 3000 |
| robot_1600 | 14399 | 9601 | ok | 35 | 6.278 | 9.14092 | 8.5e-16 | 0 | 0 | 43 | 36 | 43 | 36 | 35 | ok | 23 | 0.448 | 9.1408 | 3.9e-12 | 25 | 97 | 25 | 24 | 25 | 24 | 23 | ok | 23 | 0.453 | 9.1408 | 3.9e-12 | 28 | 105 | 25 | 24 | 25 | 24 | 23 |
| robot_a | 1001 | 52013 | t | 3000 | 600.000 | 8.65351 | 1.2e+00 | 0 | 0 | 3002 | 3001 | 36477 | 3001 | 3000 | i | 3000 | 45.466 | 7.25054 | 5.7e-01 | 3860 | 5429 | 31971 | 3001 | 37183 | 3005 | 3000 | i | 3000 | 47.605 | 8.12842 | 1.6e+00 | 4571 | 4272 | 15470 | 3001 | 32634 | 3012 | 3000 |
| robot_b | 1001 | 52013 | t | 3000 | 600.000 | 15.2596 | 1.1e+03 | 0 | 0 | 3002 | 3001 | 33595 | 3001 | 3000 | i | 3000 | 42.723 | 2.33335 | 6.1e-05 | 4968 | 5923 | 32172 | 3001 | 32172 | 3023 | 3000 | ok | 2877 | 47.018 | 2.3331 | 6.0e-09 | 4732 | 5710 | 31328 | 2878 | 31328 | 2901 | 2877 |
| robot_c | 1001 | 52013 | t | 3000 | 600.000 | 29.0105 | 2.5e+01 | 0 | 0 | 3332 | 3001 | 34117 | 3001 | 3000 | i | 3000 | 47.013 | 11.5532 | 1.1e+00 | 7565 | 6137 | 36172 | 3001 | 36172 | 3001 | 3000 | i | 3000 | 49.885 | 11.5532 | 1.1e+00 | 7565 | 6142 | 36172 | 3001 | 36172 | 3001 | 3000 |
| rocket_12800 | 51201 | 38400 | ok | 30 | 23.161 | 1.01279 | 2.2e-16 | 0 | 0 | 31 | 31 | 31 | 31 | 30 | ok | 30 | 1.141 | 1.01301 | 3.3e-14 | 30 | 64 | 37 | 31 | 37 | 31 | 30 | ok | 30 | 1.167 | 1.01301 | 3.3e-14 | 30 | 65 | 37 | 31 | 37 | 31 | 30 |
| steering_12800 | 64000 | 51201 | ok | 23 | 49.247 | 0.554571 | 7.1e-15 | 0 | 0 | 25 | 24 | 25 | 24 | 23 | ok | 165 | 13.160 | 0.554571 | 1.3e-14 | 394 | 402 | 214 | 165 | 214 | 167 | 164 | ok | 179 | 14.077 | 0.554571 | 1.3e-14 | 425 | 404 | 281 | 178 | 281 | 181 | 177 |
| svanberg | 50000 | 50000 | ok | 34 | 25.943 | 83623.8 | 5.3e-09 | 0 | 0 | 35 | 35 | 58 | 35 | 34 | ok | 26 | 0.500 | 83623.8 | 5.3e-09 | 34 | 43 | 33 | 27 | 33 | 27 | 26 | ok | 26 | 0.543 | 83623.8 | 5.3e-09 | 34 | 43 | 33 | 27 | 33 | 27 | 26 |