COPS CUDA
| set | device | problems | Ipopt | current augmented_cudss | current condensed_cudss_bk | ||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| solved | SGM (s) | SSGM | solved | SGM (s) | SSGM | solved | SGM (s) | SSGM | |||
| COPS | CUDA | 65/65 | 61 | 21.16 | 1 | 59 | 8.88 | 0.606 | 64 | 4.02 | 0.45 |
Outcomes
| solver | solved | acceptable | time limit | iteration limit | other failure | not run yet |
|---|---|---|---|---|---|---|
| Ipopt | 61 | 0 | 4 | 0 | 0 | 0 |
| current augmented_cudss | 59 | 0 | 0 | 0 | 6 | 0 |
| current condensed_cudss_bk | 64 | 0 | 0 | 1 | 0 | 0 |
Solved by problem size
| solver | small | medium | large |
|---|---|---|---|
| Ipopt | 24/24 | 20/21 | 17/20 |
| current augmented_cudss | 23/24 | 19/21 | 17/20 |
| current condensed_cudss_bk | 23/24 | 21/21 | 20/20 |
Performance profiles
Over the 65 instances that all of them have a result for. A curve gives the share of them solved within a factor of the best.
Ipoptcurrent augmented_cudsscurrent condensed_cudss_bk
Wall time
Iterations
Time breakdown
| solver | total (s) | linear solver | evaluations | initialization | other |
|---|---|---|---|---|---|
| current augmented_cudss | 371.2 | 49.2% | 20.4% | 17.5% | 13.0% |
| current condensed_cudss_bk | 949.8 | 85.2% | 0.5% | 0.2% | 14.1% |
Result files: NVIDIA RTX PRO 6000 Blackwell Server Edition, NVIDIA RTX PRO 6000 Blackwell Server Edition
Instances
nv, nc: variables, constraints. st: ok solved, a solved to the acceptable level, t time limit, i iteration limit, f other failure; click it for the solver log. it: iterations. inf: infeasibility. nfac, nsol: factorizations, linear solves. nf, ng, nc, nj, nh: evaluations of the objective, gradient, constraints, Jacobian, Hessian.
| instance | nv | nc | Ipopt | current augmented_cudss | current condensed_cudss_bk | |||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | st | it | t (s) | obj | inf | nfac | nsol | nf | ng | nc | nj | nh | |||
| bearing_200x200 | 40804 | 808 | ok | 18 | 1.986 | -0.154793 | 1.0e-08 | 0 | 0 | 19 | 19 | 19 | 19 | 18 | f | 93 | 7.410 | 970.972 | 1.6e-14 | 261 | 186 | 82 | 82 | 82 | 94 | 93 | ok | 15 | 0.249 | -0.154793 | 0.0e+00 | 15 | 30 | 17 | 16 | 17 | 16 | 15 |
| bearing_300x300 | 91204 | 1208 | ok | 19 | 10.174 | -0.154743 | 1.0e-08 | 0 | 0 | 22 | 20 | 22 | 20 | 19 | f | 108 | 2.508 | 782.892 | 8.4e-15 | 304 | 216 | 95 | 95 | 103 | 109 | 108 | ok | 14 | 0.393 | -0.154731 | 0.0e+00 | 14 | 28 | 16 | 15 | 16 | 15 | 14 |
| bearing_400x400 | 161604 | 1608 | ok | 18 | 39.943 | -0.154675 | 1.0e-08 | 0 | 0 | 19 | 19 | 19 | 19 | 18 | f | 108 | 4.243 | 1135.94 | 3.9e-14 | 304 | 216 | 95 | 95 | 107 | 109 | 108 | ok | 14 | 0.675 | -0.154662 | 0.0e+00 | 14 | 28 | 16 | 15 | 16 | 15 | 14 |
| bearing_600x600 | 362404 | 2408 | ok | 18 | 25.871 | -0.15449 | 1.0e-08 | 0 | 0 | 19 | 19 | 19 | 19 | 18 | f | 114 | 8.939 | 1576.58 | 3.3e-14 | 324 | 228 | 100 | 100 | 113 | 115 | 114 | ok | 14 | 1.769 | -0.154468 | 0.0e+00 | 14 | 28 | 16 | 15 | 16 | 15 | 14 |
| bearing_800x800 | 643204 | 3208 | ok | 18 | 55.365 | -0.154239 | 1.0e-08 | 0 | 0 | 19 | 19 | 19 | 19 | 18 | f | 110 | 15.451 | 3316.44 | 2.9e-14 | 320 | 220 | 96 | 96 | 116 | 111 | 110 | ok | 14 | 2.726 | -0.154183 | 0.0e+00 | 14 | 28 | 16 | 15 | 16 | 15 | 14 |
| camshape_12800 | 12800 | 25603 | ok | 164 | 261.224 | 4.75195 | 6.5e-11 | 0 | 0 | 200 | 162 | 200 | 174 | 164 | ok | 924 | 3.025 | 4.75195 | 1.2e-11 | 899 | 1784 | 1983 | 896 | 1983 | 926 | 887 | ok | 114 | 0.362 | 4.75195 | 2.1e-11 | 117 | 268 | 127 | 115 | 127 | 118 | 114 |
| camshape_1600 | 1600 | 3203 | ok | 77 | 2.369 | 4.28645 | 7.8e-12 | 0 | 0 | 92 | 77 | 92 | 82 | 77 | ok | 76 | 6.917 | 4.18394 | 1.6e-03 | 75 | 160 | 125 | 75 | 125 | 77 | 74 | ok | 64 | 0.337 | 4.28645 | 7.8e-12 | 67 | 134 | 75 | 65 | 75 | 68 | 64 |
| camshape_25600 | 25600 | 51203 | t | 140 | 600.000 | 5.12941 | 1.7e-11 | 0 | 0 | 188 | 137 | 188 | 152 | 140 | ok | 1530 | 4.637 | 5.12941 | 1.2e-12 | 1538 | 3070 | 1598 | 1530 | 1598 | 1532 | 1529 | ok | 98 | 0.323 | 5.12941 | 1.7e-11 | 101 | 219 | 116 | 99 | 116 | 102 | 98 |
| camshape_3200 | 3200 | 6403 | ok | 80 | 6.064 | 4.32296 | 8.7e-12 | 0 | 0 | 93 | 79 | 93 | 85 | 80 | ok | 88 | 0.259 | 4.30335 | 8.8e-04 | 93 | 174 | 120 | 87 | 120 | 89 | 86 | ok | 75 | 0.209 | 4.32296 | 1.5e-10 | 79 | 158 | 90 | 76 | 90 | 80 | 75 |
| camshape_6400 | 6400 | 12803 | ok | 130 | 56.706 | 4.44838 | 3.9e-12 | 0 | 0 | 160 | 128 | 160 | 138 | 130 | ok | 636 | 1.487 | 4.44838 | 1.7e-11 | 639 | 1282 | 693 | 637 | 693 | 639 | 636 | ok | 78 | 0.229 | 4.44838 | 1.2e-11 | 81 | 171 | 97 | 79 | 97 | 82 | 78 |
| catmix_100 | 2302 | 2002 | ok | 20 | 0.236 | -0.0480554 | 2.6e-12 | 0 | 0 | 21 | 21 | 21 | 21 | 20 | ok | 20 | 0.065 | -0.0480554 | 2.6e-12 | 21 | 42 | 21 | 21 | 21 | 21 | 20 | ok | 32 | 0.192 | -0.0480567 | 5.4e-09 | 54 | 212 | 35 | 33 | 35 | 33 | 32 |
| chain_800 | 800 | 602 | ok | 7 | 0.042 | 5.06892 | 6.8e-10 | 0 | 0 | 8 | 8 | 8 | 8 | 7 | ok | 7 | 3.280 | 5.06892 | 6.8e-10 | 10 | 16 | 8 | 8 | 8 | 8 | 7 | ok | 13 | 0.045 | 5.06892 | 1.3e-12 | 23 | 26 | 15 | 14 | 15 | 14 | 13 |
| channel_100 | 4000 | 4000 | ok | 5 | 0.145 | 1 | 4.3e-14 | 0 | 0 | 11 | 6 | 11 | 6 | 5 | ok | 6 | 5.279 | 1 | 3.6e-14 | 7 | 16 | 12 | 7 | 12 | 7 | 6 | ok | 7 | 0.043 | 1 | 4.1e-14 | 7 | 23 | 14 | 8 | 14 | 8 | 7 |
| dirichlet_20 | 33199 | 24261 | ok | 34 | 51.420 | 0.0171465 | 3.9e-10 | 0 | 0 | 35 | 35 | 35 | 35 | 34 | ok | 34 | 7.295 | 0.0171465 | 3.9e-10 | 70 | 70 | 35 | 35 | 35 | 35 | 34 | ok | 52 | 32.668 | 0.00877343 | 5.5e-09 | 111 | 213 | 64 | 53 | 64 | 53 | 52 |
| elec_100 | 300 | 100 | ok | 343 | 6.338 | 4448.57 | 1.2e-12 | 0 | 0 | 578 | 344 | 578 | 344 | 343 | ok | 227 | 3.340 | 4448.35 | 2.2e-09 | 554 | 490 | 484 | 228 | 484 | 229 | 227 | ok | 63 | 0.429 | 4448.35 | 6.0e-09 | 152 | 139 | 89 | 64 | 89 | 64 | 63 |
| elec_1600 | 4800 | 1600 | t | 391 | 600.000 | 1.24464e+06 | 8.4e-02 | 0 | 0 | 604 | 392 | 604 | 392 | 391 | ok | 389 | 94.167 | 1.24465e+06 | 7.8e-09 | 972 | 1741 | 677 | 390 | 677 | 391 | 389 | ok | 230 | 26.648 | 1.24465e+06 | 2.6e-09 | 567 | 622 | 291 | 231 | 291 | 231 | 230 |
| elec_200 | 600 | 200 | ok | 109 | 9.227 | 18439.2 | 1.2e-13 | 0 | 0 | 131 | 110 | 131 | 110 | 109 | ok | 153 | 1.871 | 18439.1 | 4.0e-10 | 376 | 308 | 213 | 154 | 213 | 154 | 153 | ok | 75 | 0.795 | 18439.1 | 7.0e-11 | 184 | 158 | 103 | 76 | 103 | 76 | 75 |
| elec_400 | 1200 | 400 | ok | 136 | 81.694 | 75583 | 1.6e-13 | 0 | 0 | 190 | 137 | 190 | 137 | 136 | ok | 102 | 2.909 | 75582.9 | 1.9e-10 | 245 | 436 | 119 | 103 | 119 | 103 | 102 | ok | 196 | 3.699 | 75583.3 | 1.7e-10 | 475 | 526 | 284 | 197 | 284 | 197 | 196 |
| elec_800 | 2400 | 800 | t | 244 | 600.000 | 307503 | 7.1e-10 | 0 | 0 | 362 | 245 | 362 | 245 | 244 | ok | 265 | 15.299 | 307504 | 8.4e-10 | 651 | 1045 | 454 | 266 | 454 | 267 | 265 | ok | 389 | 14.536 | 307503 | 7.9e-10 | 946 | 1227 | 1072 | 390 | 1072 | 396 | 389 |
| gasoil_12800 | 332803 | 332800 | ok | 14 | 82.521 | 0.0052366 | 1.2e-13 | 0 | 0 | 34 | 15 | 34 | 15 | 14 | ok | 15 | 1.168 | 0.0052366 | 4.4e-09 | 17 | 44 | 34 | 16 | 34 | 16 | 15 | ok | 116 | 118.975 | 0.00523593 | 1.0e-08 | 279 | 1980 | 124 | 117 | 124 | 117 | 116 |
| gasoil_1600 | 41603 | 41600 | ok | 17 | 2.726 | 0.0052366 | 3.6e-09 | 0 | 0 | 36 | 18 | 36 | 18 | 17 | ok | 15 | 0.166 | 0.0052366 | 1.7e-13 | 16 | 44 | 35 | 16 | 35 | 16 | 15 | ok | 20 | 1.545 | 0.00523651 | 6.4e-13 | 33 | 267 | 30 | 21 | 30 | 21 | 20 |
| gasoil_3200 | 83203 | 83200 | ok | 14 | 11.609 | 0.0052366 | 1.7e-13 | 0 | 0 | 32 | 15 | 32 | 15 | 14 | ok | 14 | 0.276 | 0.0052366 | 6.2e-09 | 15 | 42 | 34 | 15 | 34 | 15 | 14 | ok | 68 | 16.566 | 0.00523643 | 4.8e-15 | 153 | 1156 | 76 | 69 | 76 | 69 | 68 |
| gasoil_6400 | 166403 | 166400 | ok | 15 | 24.563 | 0.0052366 | 1.3e-13 | 0 | 0 | 32 | 16 | 32 | 16 | 15 | ok | 15 | 0.563 | 0.0052366 | 4.5e-09 | 17 | 44 | 34 | 16 | 34 | 16 | 15 | ok | 153 | 82.971 | 0.00523626 | 1.6e-08 | 376 | 2955 | 161 | 154 | 161 | 154 | 153 |
| gasoil_800 | 20803 | 20800 | ok | 15 | 2.059 | 0.0052366 | 1.5e-13 | 0 | 0 | 32 | 16 | 32 | 16 | 15 | ok | 15 | 6.189 | 0.0052366 | 3.4e-09 | 16 | 42 | 33 | 16 | 33 | 16 | 15 | ok | 18 | 0.278 | 0.00523655 | 4.0e-10 | 22 | 110 | 26 | 19 | 26 | 19 | 18 |
| glider_100 | 506 | 407 | ok | 849 | 6.856 | -1255.06 | 2.3e-13 | 0 | 0 | 860 | 426 | 860 | 852 | 849 | ok | 261 | 60.422 | -1255.06 | 2.1e-10 | 590 | 542 | 287 | 262 | 287 | 268 | 261 | ok | 276 | 0.974 | -1255.06 | 2.0e-08 | 634 | 583 | 298 | 276 | 298 | 280 | 275 |
| henon_10 | 12793 | 10115 | ok | 151 | 35.318 | 7.29797 | 2.2e-11 | 0 | 0 | 304 | 152 | 305 | 152 | 151 | ok | 196 | 5.150 | 7.29797 | 8.0e-11 | 468 | 499 | 373 | 197 | 373 | 197 | 196 | i | 3000 | 516.679 | 58.0029 | 1.1e+00 | 7568 | 6145 | 3105 | 2999 | 3105 | 3005 | 2998 |
| lane_emden_20 | 34519 | 24941 | ok | 81 | 110.842 | 9.11 | 3.1e-10 | 0 | 0 | 83 | 82 | 83 | 82 | 81 | ok | 81 | 4.386 | 9.11 | 3.1e-10 | 191 | 166 | 83 | 82 | 83 | 82 | 81 | ok | 48 | 27.865 | 9.10999 | 7.7e-10 | 106 | 121 | 60 | 49 | 60 | 49 | 48 |
| marine_1600 | 51215 | 51192 | ok | 12 | 10.693 | 1.97465e+07 | 3.6e-12 | 0 | 0 | 14 | 13 | 14 | 13 | 12 | ok | 13 | 0.207 | 1.97465e+07 | 3.6e-12 | 14 | 36 | 19 | 14 | 19 | 14 | 13 | ok | 18 | 0.259 | 1.97465e+07 | 5.6e-12 | 21 | 39 | 19 | 19 | 19 | 19 | 18 |
| marine_3200 | 102415 | 102392 | ok | 20 | 98.513 | 1.97465e+07 | 3.6e-12 | 0 | 0 | 29 | 21 | 29 | 21 | 20 | ok | 11 | 0.371 | 1.97465e+07 | 3.6e-12 | 12 | 26 | 14 | 12 | 14 | 12 | 11 | ok | 22 | 0.552 | 1.97465e+07 | 5.0e-12 | 25 | 50 | 24 | 23 | 24 | 23 | 22 |
| marine_400 | 12815 | 12792 | ok | 10 | 0.906 | 1.97465e+07 | 3.6e-12 | 0 | 0 | 11 | 11 | 11 | 11 | 10 | ok | 10 | 5.826 | 1.97465e+07 | 3.6e-12 | 11 | 22 | 11 | 11 | 11 | 11 | 10 | ok | 18 | 0.120 | 1.97465e+07 | 4.2e-12 | 21 | 37 | 19 | 19 | 19 | 19 | 18 |
| marine_6400 | 204815 | 204792 | t | 23 | 600.000 | 1.97465e+07 | 2.4e-12 | 0 | 0 | 62 | 24 | 62 | 24 | 23 | ok | 11 | 0.755 | 1.97465e+07 | 3.6e-12 | 12 | 28 | 16 | 12 | 16 | 12 | 11 | ok | 26 | 1.138 | 1.97465e+07 | 5.7e-12 | 29 | 70 | 31 | 27 | 31 | 27 | 26 |
| marine_800 | 25615 | 25592 | ok | 12 | 2.970 | 1.97465e+07 | 2.9e-12 | 0 | 0 | 13 | 13 | 13 | 13 | 12 | ok | 10 | 0.281 | 1.97465e+07 | 3.6e-12 | 11 | 22 | 11 | 11 | 11 | 11 | 10 | ok | 18 | 0.166 | 1.97465e+07 | 3.9e-12 | 21 | 37 | 19 | 19 | 19 | 19 | 18 |
| methanol_100 | 3005 | 3000 | ok | 21 | 0.395 | 0.00902229 | 1.7e-12 | 0 | 0 | 29 | 22 | 29 | 22 | 21 | ok | 21 | 4.966 | 0.00902229 | 1.7e-12 | 26 | 46 | 26 | 22 | 26 | 22 | 21 | ok | 21 | 0.147 | 0.00902228 | 6.0e-09 | 35 | 87 | 34 | 22 | 34 | 22 | 21 |
| minsurf_50x50 | 2704 | 3696 | ok | 91 | 2.144 | 2.51489 | 6.7e-09 | 0 | 0 | 286 | 92 | 286 | 92 | 91 | f | 66 | 4.781 | 3.88245 | 5.7e-14 | 346 | 132 | 47 | 47 | 50 | 67 | 66 | ok | 12 | 0.060 | 2.51489 | 9.9e-17 | 12 | 24 | 13 | 13 | 13 | 13 | 12 |
| pinene_12800 | 640005 | 640000 | ok | 22 | 474.474 | 19.8722 | 1.4e-14 | 0 | 0 | 97 | 23 | 97 | 23 | 22 | ok | 11 | 2.732 | 19.8722 | 5.7e-14 | 12 | 29 | 12 | 12 | 12 | 12 | 11 | ok | 13 | 3.331 | 19.8668 | 2.5e-14 | 16 | 34 | 15 | 14 | 15 | 14 | 13 |
| pinene_1600 | 80005 | 80000 | ok | 11 | 5.596 | 19.8722 | 2.4e-14 | 0 | 0 | 12 | 12 | 12 | 12 | 11 | ok | 10 | 1.227 | 19.8722 | 1.4e-14 | 14 | 36 | 11 | 11 | 11 | 11 | 10 | ok | 14 | 0.382 | 19.8668 | 2.1e-14 | 17 | 30 | 15 | 15 | 15 | 15 | 14 |
| pinene_3200 | 160005 | 160000 | ok | 18 | 39.170 | 19.8722 | 1.4e-14 | 0 | 0 | 60 | 19 | 60 | 19 | 18 | ok | 11 | 0.695 | 19.8722 | 1.4e-14 | 15 | 80 | 12 | 12 | 12 | 12 | 11 | ok | 14 | 0.763 | 19.8668 | 2.3e-14 | 17 | 29 | 16 | 15 | 16 | 15 | 14 |
| pinene_6400 | 320005 | 320000 | ok | 13 | 79.430 | 19.8722 | 1.4e-14 | 0 | 0 | 14 | 14 | 14 | 14 | 13 | ok | 15 | 7.177 | 19.8722 | 1.4e-14 | 22 | 45 | 16 | 16 | 16 | 16 | 15 | ok | 14 | 1.580 | 19.8668 | 2.5e-14 | 17 | 32 | 16 | 15 | 16 | 15 | 14 |
| pinene_800 | 40005 | 40000 | ok | 11 | 2.138 | 19.8722 | 1.4e-14 | 0 | 0 | 12 | 12 | 12 | 12 | 11 | ok | 13 | 5.116 | 19.8722 | 1.4e-14 | 21 | 67 | 14 | 14 | 14 | 14 | 13 | ok | 14 | 0.200 | 19.8668 | 2.6e-14 | 17 | 28 | 15 | 15 | 15 | 15 | 14 |
| polygon_100 | 100 | 1276 | ok | 30 | 0.262 | -0.674981 | 3.5e-11 | 0 | 0 | 31 | 31 | 31 | 31 | 30 | ok | 48 | 1.921 | -0.674981 | 2.8e-11 | 91 | 98 | 49 | 49 | 49 | 49 | 48 | ok | 57 | 0.176 | -0.726868 | 2.0e-08 | 99 | 114 | 59 | 58 | 59 | 58 | 57 |
| robot_1600 | 14410 | 9612 | ok | 31 | 3.681 | 9.14093 | 5.6e-11 | 0 | 0 | 38 | 32 | 38 | 32 | 31 | ok | 30 | 0.258 | 9.14093 | 1.9e-12 | 38 | 68 | 37 | 31 | 37 | 31 | 30 | ok | 30 | 0.360 | 9.14082 | 5.9e-12 | 34 | 65 | 31 | 31 | 31 | 31 | 30 |
| robot_3200 | 28810 | 19212 | ok | 40 | 10.502 | 9.14094 | 8.3e-14 | 0 | 0 | 53 | 41 | 53 | 41 | 40 | ok | 40 | 0.513 | 9.14094 | 8.3e-14 | 49 | 120 | 53 | 41 | 53 | 41 | 40 | ok | 26 | 0.537 | 9.14068 | 1.9e-12 | 30 | 56 | 27 | 27 | 27 | 27 | 26 |
| robot_400 | 3610 | 2412 | ok | 25 | 0.821 | 9.14103 | 1.7e-15 | 0 | 0 | 29 | 26 | 29 | 26 | 25 | ok | 25 | 5.605 | 9.14103 | 1.7e-15 | 41 | 52 | 29 | 26 | 29 | 26 | 25 | ok | 21 | 0.159 | 9.141 | 7.3e-14 | 25 | 56 | 22 | 22 | 22 | 22 | 21 |
| robot_6400 | 57610 | 38412 | ok | 73 | 172.651 | 9.14096 | 8.9e-15 | 0 | 0 | 79 | 74 | 79 | 74 | 73 | ok | 42 | 0.833 | 9.14096 | 9.9e-15 | 55 | 134 | 54 | 43 | 54 | 43 | 42 | ok | 29 | 1.181 | 9.14045 | 1.7e-13 | 33 | 65 | 30 | 30 | 30 | 30 | 29 |
| robot_800 | 7210 | 4812 | ok | 46 | 4.775 | 9.14095 | 4.4e-14 | 0 | 0 | 62 | 47 | 62 | 47 | 46 | ok | 35 | 0.230 | 9.14095 | 4.0e-13 | 48 | 86 | 54 | 35 | 63 | 37 | 34 | ok | 82 | 0.587 | 9.14088 | 2.4e-13 | 86 | 240 | 102 | 83 | 102 | 83 | 82 |
| rocket_12800 | 51205 | 38404 | ok | 29 | 76.525 | 1.01279 | 2.2e-16 | 0 | 0 | 30 | 30 | 30 | 30 | 29 | ok | 116 | 0.570 | 1.01279 | 2.2e-16 | 134 | 292 | 304 | 117 | 304 | 118 | 116 | ok | 69 | 2.819 | 1.01306 | 3.3e-13 | 69 | 509 | 70 | 70 | 70 | 70 | 69 |
| rocket_25600 | 102405 | 76804 | ok | 31 | 105.286 | 1.01275 | 1.5e-14 | 0 | 0 | 32 | 32 | 32 | 32 | 31 | ok | 122 | 0.834 | 1.01275 | 1.5e-14 | 140 | 341 | 276 | 122 | 276 | 124 | 121 | ok | 79 | 6.579 | 1.01328 | 7.3e-14 | 79 | 641 | 80 | 80 | 80 | 80 | 79 |
| rocket_3200 | 12805 | 9604 | ok | 29 | 5.868 | 1.01283 | 8.1e-13 | 0 | 0 | 30 | 30 | 30 | 30 | 29 | ok | 63 | 3.962 | 1.01283 | 8.1e-13 | 84 | 179 | 179 | 64 | 179 | 65 | 63 | ok | 46 | 0.480 | 1.01289 | 1.2e-11 | 46 | 257 | 47 | 47 | 47 | 47 | 46 |
| rocket_51200 | 204805 | 153604 | ok | 35 | 281.652 | 1.01266 | 2.2e-16 | 0 | 0 | 36 | 36 | 36 | 36 | 35 | ok | 38 | 0.957 | 1.01266 | 2.2e-16 | 47 | 85 | 45 | 39 | 45 | 39 | 38 | ok | 104 | 16.714 | 1.01371 | 1.2e-14 | 104 | 815 | 109 | 105 | 109 | 105 | 104 |
| rocket_6400 | 25605 | 19204 | ok | 30 | 11.177 | 1.01281 | 1.1e-15 | 0 | 0 | 32 | 31 | 32 | 31 | 30 | ok | 69 | 0.295 | 1.01281 | 1.1e-15 | 92 | 166 | 154 | 70 | 154 | 71 | 69 | ok | 2958 | 46.727 | 1.01292 | 4.9e-11 | 3036 | 9689 | 3075 | 2959 | 3075 | 2959 | 2958 |
| steering_12800 | 64006 | 51208 | ok | 15 | 19.963 | 0.554571 | 2.2e-11 | 0 | 0 | 17 | 16 | 17 | 16 | 15 | ok | 15 | 0.412 | 0.554571 | 2.3e-11 | 24 | 36 | 17 | 16 | 17 | 16 | 15 | ok | 20 | 1.257 | 0.554571 | 1.4e-11 | 40 | 52 | 25 | 21 | 25 | 21 | 20 |
| steering_25600 | 128006 | 102408 | ok | 16 | 21.164 | 0.554571 | 4.4e-10 | 0 | 0 | 18 | 17 | 18 | 17 | 16 | ok | 16 | 0.790 | 0.554571 | 4.3e-10 | 25 | 42 | 18 | 17 | 18 | 17 | 16 | ok | 20 | 2.940 | 0.55457 | 1.2e-11 | 37 | 84 | 21 | 21 | 21 | 21 | 20 |
| steering_3200 | 16006 | 12808 | ok | 15 | 1.678 | 0.554571 | 3.4e-09 | 0 | 0 | 17 | 16 | 17 | 16 | 15 | ok | 16 | 3.318 | 0.554571 | 3.3e-09 | 23 | 40 | 21 | 17 | 21 | 17 | 16 | ok | 16 | 0.378 | 0.554571 | 2.5e-09 | 28 | 99 | 24 | 17 | 24 | 17 | 16 |
| steering_51200 | 256006 | 204808 | ok | 17 | 58.513 | 0.554571 | 4.8e-09 | 0 | 0 | 19 | 18 | 19 | 18 | 17 | ok | 17 | 1.596 | 0.554571 | 4.8e-09 | 26 | 46 | 19 | 18 | 19 | 18 | 17 | ok | 18 | 5.977 | 0.55457 | 3.0e-11 | 33 | 57 | 19 | 19 | 19 | 19 | 18 |
| steering_6400 | 32006 | 25608 | ok | 16 | 4.743 | 0.554571 | 3.6e-11 | 0 | 0 | 18 | 17 | 18 | 17 | 16 | ok | 16 | 0.255 | 0.554571 | 1.6e-12 | 23 | 46 | 19 | 17 | 19 | 17 | 16 | ok | 29 | 0.990 | 0.554571 | 4.7e-11 | 52 | 110 | 32 | 30 | 32 | 30 | 29 |
| tetra_duct12 | 12597 | 19222 | ok | 10 | 5.973 | 22307.6 | 6.4e-10 | 0 | 0 | 11 | 11 | 14 | 11 | 10 | ok | 10 | 40.588 | 22307.6 | 6.5e-10 | 13 | 28 | 14 | 11 | 14 | 11 | 10 | ok | 14 | 0.230 | 22307.6 | 1.0e-11 | 14 | 34 | 18 | 15 | 18 | 15 | 14 |
| tetra_duct15 | 6417 | 9000 | ok | 11 | 3.602 | 10495.1 | 3.5e-10 | 0 | 0 | 12 | 12 | 15 | 12 | 11 | ok | 11 | 0.244 | 10495.1 | 3.6e-10 | 14 | 30 | 15 | 12 | 15 | 12 | 11 | ok | 14 | 0.142 | 10495.1 | 9.3e-12 | 14 | 34 | 18 | 15 | 18 | 15 | 14 |
| tetra_duct20 | 3201 | 4104 | ok | 11 | 1.197 | 4826.85 | 3.0e-10 | 0 | 0 | 12 | 12 | 13 | 12 | 11 | ok | 11 | 0.121 | 4826.85 | 3.1e-10 | 13 | 26 | 13 | 12 | 13 | 12 | 11 | ok | 14 | 0.104 | 4826.85 | 7.3e-12 | 14 | 30 | 16 | 15 | 16 | 15 | 14 |
| tetra_foam5 | 4011 | 4847 | ok | 8 | 0.654 | 6425.6 | 1.4e-13 | 0 | 0 | 9 | 9 | 9 | 9 | 8 | ok | 8 | 0.073 | 6425.6 | 1.5e-13 | 9 | 18 | 9 | 9 | 9 | 9 | 8 | ok | 13 | 0.115 | 6425.6 | 1.7e-14 | 13 | 28 | 16 | 14 | 16 | 14 | 13 |
| tetra_gear | 2598 | 3116 | ok | 8 | 0.476 | 4151.64 | 6.6e-15 | 0 | 0 | 9 | 9 | 9 | 9 | 8 | ok | 8 | 0.065 | 4151.64 | 6.6e-15 | 9 | 18 | 9 | 9 | 9 | 9 | 8 | ok | 11 | 0.075 | 4151.64 | 3.5e-17 | 11 | 22 | 12 | 12 | 12 | 12 | 11 |
| tetra_hook | 3570 | 4675 | ok | 10 | 0.965 | 6057.35 | 6.3e-11 | 0 | 0 | 11 | 11 | 11 | 11 | 10 | ok | 10 | 0.122 | 6057.35 | 6.3e-11 | 11 | 22 | 11 | 11 | 11 | 11 | 10 | ok | 13 | 0.118 | 6057.35 | 4.8e-13 | 13 | 30 | 17 | 14 | 17 | 14 | 13 |
| torsion_50x50 | 2704 | 2704 | ok | 13 | 0.248 | -0.418086 | 2.5e-36 | 0 | 0 | 14 | 14 | 14 | 14 | 13 | ok | 13 | 3.154 | -0.418086 | 1.7e-36 | 14 | 28 | 14 | 14 | 14 | 14 | 13 | ok | 14 | 0.062 | -0.418086 | 0.0e+00 | 14 | 28 | 15 | 15 | 15 | 15 | 14 |
| triangle_deer | 2244 | 1896 | ok | 7 | 0.135 | 2011.74 | 1.0e-13 | 0 | 0 | 8 | 8 | 8 | 8 | 7 | ok | 7 | 3.521 | 2011.74 | 1.0e-13 | 8 | 16 | 8 | 8 | 8 | 8 | 7 | ok | 10 | 0.051 | 2011.74 | 2.7e-15 | 10 | 24 | 15 | 11 | 15 | 11 | 10 |
| triangle_pacman | 1366 | 1182 | ok | 7 | 0.093 | 1250.45 | 2.0e-13 | 0 | 0 | 8 | 8 | 8 | 8 | 7 | ok | 7 | 0.042 | 1250.45 | 2.0e-13 | 8 | 16 | 8 | 8 | 8 | 8 | 7 | ok | 15 | 0.058 | 1250.44 | 2.7e-15 | 15 | 32 | 18 | 16 | 18 | 16 | 15 |
| triangle_turtle | 4444 | 4025 | ok | 9 | 0.481 | 4215.23 | 2.4e-14 | 0 | 0 | 10 | 10 | 10 | 10 | 9 | ok | 9 | 0.074 | 4215.23 | 2.4e-14 | 10 | 20 | 10 | 10 | 10 | 10 | 9 | ok | 11 | 0.063 | 4215.23 | 1.5e-15 | 11 | 22 | 12 | 12 | 12 | 12 | 11 |