Summary of all benchmarks in the SLparse competition
| 7.3 | call script runs 7.3 seconds on the benchmark instance |
| 1.1 | call script runs 1.1 seconds on the benchmark instance (first place) |
| 1.2 | call script runs 1.2 seconds on the benchmark instance (second place) |
| 2.3 | call script runs 2.3 seconds on the benchmark instance (third place) |
| R | call script runs out of time |
| S | call script runs out of memory |
| I | computed answer set is incorrect |
| NF | answer set was not found (only for incomplete solvers) |
| CR | call script/solver can't read the input format e.g. extended rules |
|
Factoring
|
|
| pbmodels-wsatcc-SLparse | NF | NF | NF | NF | | smodels_rsn_slparse | 0.6 | 110.1 | 2.9 | 99.6 | | smodels_slparse | 1.1 | 5.2 | 3.5 | 40.6 | | clasp_cmp_slparse2 | 1.7 | 39.6 | 5.6 | 103.7 | | pbmodels-minisat+-SLparse | 1.8 | 5.3 | 6.4 | 67.1 | | script.assat.lparse-output | 2.0 | 31.4 | 6.0 | 121.7 | | gnt_slparse | 2.1 | 19.8 | 4.4 | 53.3 | | dencode_bc+gnt_slparse | 2.1 | 19.6 | 4.3 | 54.7 | | dencode+gnt_slparse | 2.2 | 19.4 | 4.4 | 53.3 | | smodels_rs_slparse | 2.4 | 8.3 | 3.6 | 41.4 | | pbmodels-pueblo-SLparse | 3.8 | 39.2 | 9.2 | 138.2 | | clasp_slparse_def | 4.0 | 29.2 | 5.9 | 73.7 | | clasp_cmp_slparse | 5.3 | 9.7 | 5.2 | 72.3 | | groundedDefault | 9.9 | 185.8 | 12.7 | R | | scriptEloopGr | 9.9 | 187.1 | 12.8 | R | | scriptAtomreasonGr | 9.9 | 287.0 | 12.8 | R | | nomore-localprop-slparse | 14.4 | 240.3 | 33.6 | 414.8 | | nomore-D-slparse | 14.5 | 288.3 | 29.0 | 406.8 | | nomore-default-slparse | 17.1 | 297.7 | 41.2 | 549.8 |
HamiltonianPath
|
|
| nomore-default-slparse | R | R | 355.3 | R | R | | nomore-D-slparse | R | 530.4 | R | R | 43.8 | | nomore-localprop-slparse | R | R | R | R | 4.4 | | pbmodels-pueblo-SLparse | R | 492.3 | R | R | 160.0 | | pbmodels-wsatcc-SLparse | NF | R | NF | NF | 36.7 | | smodels_slparse | R | R | 43.3 | R | R | | smodels_rs_slparse | R | 12.5 | 12.1 | 23.9 | 3.8 | | smodels_rsn_slparse | R | 380.2 | R | R | 2.2 | | gnt_slparse | R | 14.2 | 46.6 | R | 2.9 | | dencode+gnt_slparse | R | 14.3 | 46.8 | R | 2.8 | | dencode_bc+gnt_slparse | R | 14.1 | 46.5 | R | 2.8 | | clasp_cmp_slparse2 | 0.6 | 0.4 | 0.4 | 0.7 | 0.5 | | clasp_slparse_def | 0.6 | 0.4 | 0.4 | 0.7 | 0.5 | | clasp_cmp_slparse | 0.6 | 0.4 | 0.4 | 0.5 | 0.5 | | scriptEloopGr | 2.3 | 1.9 | 1.7 | 1.4 | 4.4 | | groundedDefault | 2.3 | 1.9 | 1.8 | 1.4 | 4.4 | | scriptAtomreasonGr | 4.9 | 3.8 | 5.8 | 4.4 | 15.3 | | script.assat.lparse-output | 13.1 | 39.2 | 5.6 | 30.7 | R | | pbmodels-minisat+-SLparse | 228.8 | R | 427.7 | R | 378.6 |
BoundedSpanningTree
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | smodels_slparse | R | R | 193.1 | 278.7 | 199.0 | | smodels_rs_slparse | R | R | 192.0 | 413.6 | 199.7 | | smodels_rsn_slparse | R | R | 224.3 | 55.7 | 56.9 | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-minisat+-SLparse | 32.0 | 37.5 | 18.2 | 17.3 | 19.7 | | pbmodels-wsatcc-SLparse | 53.2 | 16.4 | 12.6 | 10.2 | 9.3 | | scriptEloopGr | 59.2 | 87.7 | 40.5 | 45.5 | 7.5 | | scriptAtomreasonGr | 59.2 | 87.5 | 40.2 | 45.4 | 7.4 | | groundedDefault | 59.4 | 87.6 | 40.4 | 45.3 | 7.5 | | pbmodels-pueblo-SLparse | 72.2 | 75.9 | 24.2 | 35.4 | 24.8 | | clasp_cmp_slparse2 | 80.7 | 63.3 | 41.4 | 34.6 | 32.9 | | clasp_cmp_slparse | 81.7 | 65.3 | 27.5 | 27.3 | 29.7 | | clasp_slparse_def | 97.2 | 89.3 | 43.1 | 31.8 | 47.7 |
HamiltonianCycle
|
|
| nomore-localprop-slparse | R | R | R | R | R | | pbmodels-pueblo-SLparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | R | R | R | R | R | | smodels_slparse | R | 3.5 | 3.9 | 17.0 | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | clasp_cmp_slparse | 1.0 | 1.0 | 4.5 | 9.1 | 52.1 | | clasp_slparse_def | 1.2 | 1.1 | 1.2 | 2.2 | 7.9 | | clasp_cmp_slparse2 | 1.2 | 10.4 | 2.9 | 12.8 | 33.8 | | smodels_rsn_slparse | 1.3 | 0.5 | 0.5 | 1.1 | 3.7 | | scriptEloopGr | 2.7 | 4.4 | 5.4 | 17.8 | 15.0 | | groundedDefault | 2.7 | 4.4 | 5.3 | 17.8 | 15.0 | | scriptAtomreasonGr | 3.7 | 7.3 | 8.8 | 18.3 | 308.3 | | smodels_rs_slparse | 8.8 | 3.5 | 3.8 | 32.4 | 132.0 | | nomore-D-slparse | 140.6 | R | 172.4 | 464.7 | R | | pbmodels-minisat+-SLparse | 156.2 | 137.6 | 50.9 | R | R | | nomore-default-slparse | 253.4 | R | R | 449.5 | R |
WeightedSpanningTree
|
|
| script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | scriptAtomreasonGr | 3.2 | 4.8 | 8.0 | 21.4 | 26.1 | | groundedDefault | 3.3 | 4.8 | 8.0 | 21.4 | 26.1 | | scriptEloopGr | 3.3 | 4.8 | 8.0 | 21.4 | 26.1 | | clasp_cmp_slparse | 8.8 | 10.8 | 11.0 | 26.5 | 32.2 | | pbmodels-minisat+-SLparse | 8.9 | 8.8 | 12.0 | 41.3 | 33.2 | | clasp_cmp_slparse2 | 9.3 | 10.2 | 12.2 | 29.0 | 24.2 | | clasp_slparse_def | 10.0 | 10.7 | 10.9 | 30.4 | 31.1 | | pbmodels-pueblo-SLparse | 12.0 | 14.0 | 16.7 | 40.1 | 84.8 | | pbmodels-wsatcc-SLparse | 26.0 | 21.4 | 7.2 | R | R | | smodels_rs_slparse | 203.8 | 348.6 | R | 315.2 | R | | nomore-localprop-slparse | 419.0 | 392.5 | 517.6 | R | R | | nomore-default-slparse | 419.2 | 396.9 | 518.3 | R | R | | smodels_slparse | 454.6 | R | 411.2 | 315.2 | R | | nomore-D-slparse | 514.8 | 470.6 | R | R | R | | smodels_rsn_slparse | 596.4 | R | R | R | R |
BlockedN-QueensCompetition
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | smodels_rsn_slparse | R | R | R | 126.9 | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-wsatcc-SLparse | 3.0 | NF | 46.7 | 2.3 | 178.5 | | groundedDefault | 6.7 | R | 407.5 | 240.0 | R | | scriptEloopGr | 6.7 | R | 407.5 | 239.8 | R | | scriptAtomreasonGr | 6.7 | R | 407.5 | 240.6 | R | | smodels_rs_slparse | 39.7 | 51.4 | 40.9 | 3.7 | 202.7 | | pbmodels-minisat+-SLparse | 120.6 | 209.2 | 1.6 | 171.7 | R | | clasp_slparse_def | 133.5 | 546.5 | 333.1 | 60.7 | R | | smodels_slparse | 155.6 | 51.3 | 82.0 | 20.0 | 97.6 | | clasp_cmp_slparse2 | 192.0 | R | 342.9 | 309.5 | R | | clasp_cmp_slparse | 233.0 | R | 395.9 | 489.1 | R | | pbmodels-pueblo-SLparse | 590.0 | R | R | 549.3 | R |
WeightBoundedDominatingSetSuite
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | R | R | R | R | R | | smodels_slparse | R | R | R | R | R | | smodels_rs_slparse | R | R | R | R | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | clasp_slparse_def | 1.6 | R | S | 467.5 | R | | clasp_cmp_slparse2 | 2.6 | 292.7 | 39.3 | R | 38.9 | | clasp_cmp_slparse | 4.5 | R | 429.0 | R | R | | pbmodels-minisat+-SLparse | 5.3 | R | R | R | R | | pbmodels-pueblo-SLparse | 10.2 | R | R | R | 4.4 | | scriptAtomreasonGr | 34.4 | R | R | R | R | | scriptEloopGr | 34.5 | R | R | R | R | | groundedDefault | 34.5 | R | R | R | R | | smodels_rsn_slparse | 289.0 | R | R | R | R |
TravelingSalespersonSuite
|
|
| nomore-default-slparse | S | S | S | S | S | | nomore-D-slparse | S | S | S | S | S | | nomore-localprop-slparse | S | S | S | S | S | | pbmodels-minisat+-SLparse | R | R | R | R | R | | pbmodels-pueblo-SLparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | R | 212.7 | NF | R | R | | clasp_slparse_def | S | S | S | S | S | | clasp_cmp_slparse | S | S | S | S | S | | clasp_cmp_slparse2 | S | S | S | S | S | | smodels_slparse | R | R | R | R | 0.5 | | groundedDefault | S | S | S | S | S | | scriptEloopGr | S | S | S | S | S | | scriptAtomreasonGr | S | S | S | S | S | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | smodels_rsn_slparse | 1.1 | 1.2 | 1.4 | 0.4 | 7.6 | | smodels_rs_slparse | 14.1 | 1.0 | 1.3 | 1.0 | 0.6 |
WeightedLatinSquareCompetition
|
|
| nomore-default-slparse | S | S | S | S | S | | nomore-D-slparse | S | S | S | S | S | | nomore-localprop-slparse | S | S | S | S | S | | pbmodels-wsatcc-SLparse | NF | 1.1 | NF | NF | NF | | clasp_slparse_def | S | S | S | S | S | | clasp_cmp_slparse | S | S | S | S | S | | clasp_cmp_slparse2 | S | S | S | S | S | | groundedDefault | S | S | S | S | S | | scriptEloopGr | S | S | S | S | S | | scriptAtomreasonGr | S | S | S | S | S | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-pueblo-SLparse | 0.3 | 0.3 | 0.3 | 0.3 | 0.3 | | pbmodels-minisat+-SLparse | 0.5 | 1.0 | 0.6 | 0.5 | 1.0 | | smodels_rsn_slparse | 156.6 | 6.7 | 248.5 | 110.6 | 321.6 | | smodels_slparse | 473.9 | 0.3 | R | 464.2 | R | | smodels_rs_slparse | 505.1 | 0.2 | R | 444.7 | 576.3 |
SocialGolfer
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | NF | R | NF | NF | NF | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | smodels_rsn_slparse | 1.0 | R | 0.9 | R | R | | clasp_slparse_def | 1.1 | R | 1.3 | 43.6 | R | | clasp_cmp_slparse2 | 1.6 | R | 1.1 | 10.7 | R | | clasp_cmp_slparse | 1.8 | R | 1.2 | 31.0 | R | | smodels_rs_slparse | 2.5 | R | 3.2 | R | R | | pbmodels-minisat+-SLparse | 3.5 | R | 2.8 | 10.4 | 0.8 | | pbmodels-pueblo-SLparse | 5.6 | 266.8 | 4.3 | 22.8 | R | | groundedDefault | 6.5 | S | 1.5 | 44.7 | 3.4 | | scriptEloopGr | 6.5 | S | 1.5 | 44.9 | 3.4 | | scriptAtomreasonGr | 6.5 | S | 1.5 | 44.9 | 3.4 | | nomore-D-slparse | 139.5 | R | 116.7 | R | R | | smodels_slparse | 291.5 | R | 1.3 | R | R |
CarSequencing
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-minisat+-SLparse | R | R | R | R | R | | pbmodels-pueblo-SLparse | R | R | R | R | R | | clasp_slparse_def | R | R | R | R | R | | clasp_cmp_slparse | R | R | R | R | R | | smodels_slparse | R | R | R | R | R | | smodels_rs_slparse | R | R | R | R | R | | smodels_rsn_slparse | R | R | R | R | R | | groundedDefault | R | R | R | R | R | | scriptEloopGr | R | R | R | R | R | | scriptAtomreasonGr | R | R | R | R | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-wsatcc-SLparse | 273.0 | R | 7.2 | 139.8 | R | | clasp_cmp_slparse2 | 553.6 | 108.0 | R | 556.5 | 108.6 |
Su-Doku
|
|
| script.assat.lparse-output | CR | CR | CR | | gnt_slparse | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | | scriptAtomreasonGr | 20.1 | 20.6 | 18.2 | | scriptEloopGr | 20.2 | 20.7 | 18.2 | | groundedDefault | 20.2 | 20.6 | 18.2 | | pbmodels-wsatcc-SLparse | 47.8 | R | R | | smodels_rs_slparse | 55.7 | 59.4 | 58.3 | | smodels_slparse | 55.7 | 59.7 | 58.2 | | smodels_rsn_slparse | 56.1 | R | 101.3 | | nomore-default-slparse | 59.6 | 176.6 | 65.3 | | nomore-localprop-slparse | 59.6 | 176.7 | 65.2 | | nomore-D-slparse | 59.7 | 77.2 | 66.0 | | clasp_cmp_slparse | 62.7 | 66.4 | 65.3 | | clasp_cmp_slparse2 | 62.9 | 66.7 | 64.6 | | clasp_slparse_def | 63.5 | 67.0 | 65.5 | | pbmodels-minisat+-SLparse | 81.8 | 84.4 | 83.6 | | pbmodels-pueblo-SLparse | 163.0 | 161.2 | 162.5 |
Hashiwokakero
|
|
| pbmodels-minisat+-SLparse | R | R | S | S | S | | pbmodels-wsatcc-SLparse | R | R | S | S | S | | groundedDefault | S | S | S | S | S | | scriptEloopGr | S | S | S | S | S | | scriptAtomreasonGr | S | S | S | S | S | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | smodels_rsn_slparse | 6.7 | 15.8 | R | R | R | | smodels_rs_slparse | 6.9 | 16.0 | 140.1 | 278.3 | 376.9 | | smodels_slparse | 6.9 | 15.9 | 140.0 | 277.0 | 377.7 | | nomore-D-slparse | 7.5 | 17.9 | S | S | S | | nomore-localprop-slparse | 7.5 | 18.2 | S | S | S | | nomore-default-slparse | 7.6 | 18.2 | S | S | S | | clasp_slparse_def | 7.8 | 18.9 | S | S | S | | clasp_cmp_slparse2 | 7.9 | 19.1 | S | S | S | | clasp_cmp_slparse | 7.9 | 19.0 | S | S | S | | pbmodels-pueblo-SLparse | 19.7 | 45.8 | S | S | S |
KnightsTour
|
|
| script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | scriptEloopGr | 3.2 | 1.2 | 1.3 | 1.0 | 12.6 | | scriptAtomreasonGr | 3.3 | 1.2 | 1.3 | 1.0 | 12.8 | | groundedDefault | 3.3 | 1.2 | 1.2 | 1.1 | 12.6 | | clasp_cmp_slparse | 3.4 | 1.9 | 2.5 | 2.4 | 10.4 | | clasp_cmp_slparse2 | 3.4 | 1.9 | 2.5 | 2.4 | 10.4 | | smodels_rsn_slparse | 3.6 | 1.6 | 2.1 | 2.0 | 8.3 | | pbmodels-wsatcc-SLparse | 4.8 | 7.7 | 7.4 | 13.9 | 16.8 | | pbmodels-minisat+-SLparse | 5.2 | 3.1 | 4.1 | 4.0 | 17.4 | | clasp_slparse_def | 6.9 | 5.2 | 8.4 | 9.4 | S | | pbmodels-pueblo-SLparse | 7.5 | 4.0 | 5.7 | 5.5 | 32.4 | | smodels_rs_slparse | 36.9 | 3.6 | 4.6 | 3.0 | 214.8 | | smodels_slparse | 37.1 | 3.6 | 4.6 | 2.9 | 216.6 | | nomore-localprop-slparse | 157.1 | 43.2 | 69.5 | 49.6 | S | | nomore-default-slparse | 158.4 | 42.9 | 69.6 | 49.6 | S | | nomore-D-slparse | 249.0 | 81.6 | 132.4 | 92.0 | S |
SolitaireForward
|
|
| pbmodels-wsatcc-SLparse | NF | NF | NF | NF | NF | | groundedDefault | S | 3.3 | 2.1 | 5.1 | R | | scriptEloopGr | S | 3.4 | 2.1 | 5.0 | R | | scriptAtomreasonGr | S | 3.3 | 2.1 | 5.0 | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | clasp_cmp_slparse2 | 1.3 | 1.7 | 1.9 | 2.9 | R | | clasp_cmp_slparse | 1.6 | 2.3 | 2.9 | 3.9 | R | | smodels_rsn_slparse | 1.7 | 1.2 | 1.2 | 1.5 | R | | pbmodels-minisat+-SLparse | 2.3 | 3.0 | 3.1 | 3.9 | 454.1 | | clasp_slparse_def | 3.1 | 5.0 | 4.9 | 10.2 | R | | pbmodels-pueblo-SLparse | 3.7 | 5.0 | 5.8 | 11.4 | 593.0 | | smodels_slparse | 5.3 | 153.5 | 12.3 | 15.2 | R | | smodels_rs_slparse | 5.3 | 27.9 | 12.3 | 15.1 | R | | nomore-default-slparse | 59.1 | 92.4 | 101.5 | 148.4 | R | | nomore-localprop-slparse | 59.2 | 93.0 | 100.9 | 147.6 | R | | nomore-D-slparse | 71.2 | 113.6 | 124.3 | 176.2 | R |
SolitaireBackward
|
|
| pbmodels-wsatcc-SLparse | NF | NF | NF | NF | NF | | smodels_slparse | R | R | R | R | 2.2 | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | clasp_cmp_slparse | 1.5 | 9.6 | 4.4 | 159.6 | 2.8 | | pbmodels-minisat+-SLparse | 2.2 | R | 110.3 | 503.6 | 4.6 | | clasp_cmp_slparse2 | 3.2 | 9.6 | 2.8 | 552.1 | 2.8 | | clasp_slparse_def | 4.6 | 8.1 | 29.0 | 171.8 | 6.6 | | groundedDefault | 16.6 | 4.4 | 269.6 | R | 0.3 | | scriptAtomreasonGr | 16.6 | 4.4 | 268.9 | R | 0.3 | | scriptEloopGr | 16.6 | 4.4 | 268.2 | R | 0.3 | | pbmodels-pueblo-SLparse | 19.3 | 95.4 | R | 65.1 | 6.4 | | smodels_rsn_slparse | 20.6 | R | R | R | 2.2 | | nomore-D-slparse | 111.0 | R | R | R | 6.6 | | smodels_rs_slparse | 119.6 | R | 93.1 | R | 2.2 | | nomore-default-slparse | 176.1 | R | R | R | 6.7 | | nomore-localprop-slparse | 177.6 | R | R | R | 6.6 |
RandomNonTight
|
|
| pbmodels-pueblo-SLparse | I | 0.4 | 0.4 | I | I | | pbmodels-wsatcc-SLparse | NF | NF | NF | NF | R | | scriptEloopGr | S | 229.6 | 149.7 | R | 13.8 | | clasp_cmp_slparse2 | 0.6 | 13.2 | 6.9 | 62.7 | 52.0 | | clasp_cmp_slparse | 1.0 | 12.0 | 9.1 | 117.5 | 46.8 | | clasp_slparse_def | 6.3 | 18.3 | 16.3 | 5.5 | 187.7 | | dencode_bc+gnt_slparse | 19.7 | 55.5 | 29.0 | 261.3 | 308.7 | | dencode+gnt_slparse | 19.7 | 55.5 | 29.1 | 261.5 | 308.8 | | gnt_slparse | 19.7 | 55.4 | 29.0 | 261.4 | 308.7 | | nomore-localprop-slparse | 20.2 | 447.2 | 251.2 | R | 309.8 | | smodels_rsn_slparse | 31.5 | 24.0 | 16.2 | 373.8 | 181.5 | | smodels_slparse | 71.2 | 48.4 | 22.3 | 518.1 | 176.8 | | nomore-default-slparse | 79.3 | R | R | R | R | | scriptAtomreasonGr | 95.4 | 213.9 | 138.8 | R | 13.8 | | smodels_rs_slparse | 103.8 | 47.4 | 22.9 | 328.6 | 246.6 | | nomore-D-slparse | 120.2 | 411.2 | 259.8 | R | 139.9 | | groundedDefault | 139.3 | 229.5 | 149.3 | R | 13.9 | | script.assat.lparse-output | 210.8 | 225.3 | 116.5 | R | R | | pbmodels-minisat+-SLparse | 228.1 | 19.8 | 17.1 | 6.4 | 224.4 |
RLP-150
|
|
| pbmodels-wsatcc-SLparse | NF | NF | NF | NF | NF | | pbmodels-pueblo-SLparse | 0.2 | 0.3 | I | 0.3 | 0.3 | | clasp_cmp_slparse | 0.9 | 0.8 | 1.1 | 1.0 | 1.4 | | clasp_cmp_slparse2 | 1.1 | 0.8 | 0.4 | 1.0 | 1.1 | | pbmodels-minisat+-SLparse | 1.6 | 9.2 | 0.6 | 0.8 | 3.7 | | clasp_slparse_def | 1.9 | 1.1 | 0.6 | 1.4 | 1.4 | | scriptAtomreasonGr | 2.0 | 2.1 | 3.2 | 2.7 | 2.5 | | groundedDefault | 2.5 | 2.4 | 3.2 | 2.7 | 3.2 | | scriptEloopGr | 2.5 | R | 3.3 | 2.7 | S | | script.assat.lparse-output | 5.2 | 7.2 | 5.4 | 8.7 | 19.7 | | smodels_slparse | 5.4 | 27.1 | 1.5 | 5.0 | 9.7 | | smodels_rs_slparse | 5.7 | 25.8 | 3.8 | 5.4 | 11.0 | | smodels_rsn_slparse | 5.8 | 5.6 | 1.2 | 5.6 | 3.7 | | dencode+gnt_slparse | 7.3 | 30.4 | 3.1 | 5.6 | 16.9 | | dencode_bc+gnt_slparse | 7.3 | 30.4 | 3.1 | 5.6 | 16.9 | | gnt_slparse | 7.3 | 30.4 | 3.1 | 5.6 | 16.9 | | nomore-localprop-slparse | 17.2 | 17.8 | 10.9 | 17.0 | 24.4 | | nomore-default-slparse | 43.7 | 48.1 | 19.4 | 35.8 | 58.5 | | nomore-D-slparse | 79.2 | 183.3 | 14.2 | 60.3 | 177.0 |
RLP-200
|
|
| pbmodels-wsatcc-SLparse | NF | 8.4 | NF | NF | NF | | pbmodels-pueblo-SLparse | 0.2 | I | 0.3 | 0.3 | 0.4 | | clasp_cmp_slparse | 1.5 | 3.7 | 2.4 | 3.0 | 4.2 | | clasp_cmp_slparse2 | 1.9 | 1.9 | 2.0 | 3.1 | 5.0 | | pbmodels-minisat+-SLparse | 2.3 | 3.2 | 2.5 | 1.6 | 1.8 | | clasp_slparse_def | 2.5 | 4.0 | 2.1 | 4.7 | 5.6 | | scriptAtomreasonGr | 8.4 | 14.5 | 8.0 | 11.5 | 10.2 | | groundedDefault | 8.9 | 14.4 | 8.0 | 11.5 | 10.2 | | scriptEloopGr | 8.9 | 14.6 | 8.1 | 11.5 | 10.2 | | smodels_rsn_slparse | 9.1 | 16.6 | 23.4 | 48.8 | 62.6 | | script.assat.lparse-output | 13.9 | 64.2 | 20.3 | 16.9 | 20.4 | | nomore-localprop-slparse | 28.8 | 53.9 | 35.6 | 71.6 | 128.5 | | smodels_rs_slparse | 73.2 | 43.7 | 23.6 | 54.7 | 163.0 | | smodels_slparse | 80.7 | 22.4 | 23.8 | 57.7 | 199.9 | | nomore-default-slparse | 97.6 | 133.1 | 106.9 | 200.0 | 344.3 | | dencode_bc+gnt_slparse | 128.0 | 10.9 | 30.0 | 124.9 | 287.8 | | gnt_slparse | 128.1 | 10.9 | 30.0 | 124.8 | 288.0 | | dencode+gnt_slparse | 128.3 | 10.9 | 30.0 | 124.7 | 287.9 | | nomore-D-slparse | 227.8 | 224.2 | 294.4 | 465.7 | R |
15-PuzzleCompetition
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | NF | NF | NF | NF | NF | | clasp_slparse_def | R | R | R | 454.3 | 164.7 | | clasp_cmp_slparse | R | 432.1 | 502.5 | 263.8 | 228.1 | | clasp_cmp_slparse2 | R | 345.1 | 444.8 | 278.4 | 346.2 | | smodels_slparse | R | R | R | R | R | | smodels_rs_slparse | R | R | R | R | R | | smodels_rsn_slparse | R | R | R | R | R | | groundedDefault | R | R | R | R | R | | scriptEloopGr | R | R | R | R | R | | scriptAtomreasonGr | R | R | R | R | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-minisat+-SLparse | 397.8 | 202.3 | 298.4 | 277.4 | 106.7 | | pbmodels-pueblo-SLparse | 431.1 | R | R | R | 394.9 |
SchurCompetition
|
|
| nomore-default-slparse | R | R | R | 494.0 | R | | nomore-D-slparse | S | R | R | R | R | | nomore-localprop-slparse | R | R | R | 496.8 | R | | pbmodels-minisat+-SLparse | R | 382.2 | R | 8.1 | 9.8 | | pbmodels-pueblo-SLparse | R | R | R | 9.8 | 18.6 | | pbmodels-wsatcc-SLparse | R | R | R | R | R | | clasp_slparse_def | R | R | R | 5.3 | 7.5 | | clasp_cmp_slparse | R | 317.7 | R | 5.4 | 6.6 | | smodels_slparse | R | R | R | 18.9 | R | | smodels_rs_slparse | R | R | R | 19.0 | R | | smodels_rsn_slparse | R | R | R | R | R | | groundedDefault | R | 99.8 | 76.5 | 1.2 | 4.7 | | scriptEloopGr | R | 100.1 | 76.4 | 1.2 | 4.7 | | scriptAtomreasonGr | R | 99.7 | 76.5 | 1.2 | 4.7 | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | clasp_cmp_slparse2 | 437.8 | 65.4 | 379.5 | 5.4 | 7.2 |
TowersOfHanoiCompetition
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | R | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | NF | NF | NF | NF | NF | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-minisat+-SLparse | 16.0 | 25.3 | 30.8 | 56.0 | 15.0 | | clasp_cmp_slparse2 | 21.0 | 33.3 | 24.4 | 303.2 | 120.1 | | clasp_slparse_def | 23.6 | 9.4 | 111.8 | R | 189.5 | | clasp_cmp_slparse | 60.7 | 75.7 | 21.6 | 102.3 | 134.6 | | pbmodels-pueblo-SLparse | 87.5 | R | 221.8 | 231.5 | 126.6 | | smodels_rsn_slparse | 259.9 | 284.6 | R | R | R | | scriptEloopGr | 322.3 | 6.3 | 404.3 | 359.5 | R | | groundedDefault | 322.6 | 6.3 | 404.6 | 358.4 | R | | scriptAtomreasonGr | 322.7 | 6.3 | 404.8 | 358.4 | R | | smodels_slparse | 345.5 | 89.8 | 136.6 | R | R | | smodels_rs_slparse | 478.3 | 59.1 | 336.3 | R | R |
searchTest-plain
|
|
| pbmodels-pueblo-SLparse | I | 115.9 | S | S | S | | pbmodels-wsatcc-SLparse | R | NF | S | S | S | | groundedDefault | 1.5 | 7.0 | 6.5 | 25.1 | S | | scriptEloopGr | 1.5 | 7.0 | 6.6 | 24.8 | S | | scriptAtomreasonGr | 1.5 | 6.9 | 6.5 | 24.8 | S | | gnt_slparse | 3.1 | 7.2 | 14.6 | 27.9 | R | | dencode_bc+gnt_slparse | 3.2 | 7.5 | 15.3 | 29.2 | R | | dencode+gnt_slparse | 3.2 | 7.5 | 15.4 | 29.2 | R | | script.assat.lparse-output | 5.4 | 14.7 | 26.5 | 40.8 | S | | smodels_rsn_slparse | 7.6 | 27.0 | 56.5 | 105.6 | R | | clasp_slparse_def | 7.7 | 26.6 | 57.5 | 108.4 | 339.5 | | clasp_cmp_slparse2 | 7.7 | 26.7 | 58.2 | 109.2 | S | | clasp_cmp_slparse | 7.7 | 26.7 | 58.1 | 109.2 | S | | smodels_slparse | 8.1 | 26.7 | 56.4 | 105.2 | R | | nomore-default-slparse | 8.2 | 27.5 | 57.9 | 111.2 | R | | nomore-localprop-slparse | 8.2 | 27.6 | 57.4 | 111.7 | R | | smodels_rs_slparse | 8.2 | 26.6 | 56.2 | 104.8 | R | | nomore-D-slparse | 8.3 | 27.3 | 57.8 | 111.2 | S | | pbmodels-minisat+-SLparse | 334.4 | 126.0 | S | S | S |
searchTest-verbose
|
|
| pbmodels-minisat+-SLparse | R | S | S | S | S | | pbmodels-pueblo-SLparse | I | S | S | S | S | | pbmodels-wsatcc-SLparse | NF | S | S | S | S | | clasp_slparse_def | S | 62.8 | 156.7 | 109.5 | 111.7 | | scriptEloopGr | 26.0 | 35.6 | S | 25.9 | 46.4 | | groundedDefault | 26.0 | 35.5 | S | 25.9 | 46.0 | | scriptAtomreasonGr | 26.0 | 35.5 | S | 25.8 | 46.2 | | clasp_cmp_slparse | 26.9 | 61.4 | 255.5 | 109.6 | 112.8 | | clasp_cmp_slparse2 | 26.9 | 61.8 | 181.5 | 109.9 | 113.4 | | smodels_slparse | 79.2 | 161.2 | R | 105.9 | 245.7 | | gnt_slparse | 83.1 | 208.8 | 482.1 | 35.3 | 109.5 | | dencode_bc+gnt_slparse | 83.4 | 209.6 | 485.4 | 36.5 | 110.9 | | script.assat.lparse-output | 83.5 | R | R | S | S | | dencode+gnt_slparse | 83.9 | 209.3 | 482.8 | 36.7 | 111.4 | | smodels_rsn_slparse | 109.3 | 201.5 | R | 105.0 | 211.5 | | smodels_rs_slparse | 130.3 | 232.4 | R | 106.1 | 243.8 | | nomore-default-slparse | 276.0 | 238.7 | R | 112.3 | R | | nomore-localprop-slparse | 278.2 | 239.4 | R | 112.8 | S | | nomore-D-slparse | 278.7 | 238.9 | R | 112.2 | S |
verifyTest-variableSearchSpace
|
|
| pbmodels-pueblo-SLparse | I | I | I | I | I | | pbmodels-wsatcc-SLparse | R | R | R | R | R | | scriptEloopGr | 0.2 | 0.5 | 0.4 | 0.3 | 0.3 | | groundedDefault | 0.2 | 0.5 | 0.4 | 0.3 | 0.3 | | scriptAtomreasonGr | 0.2 | 0.5 | 0.4 | 0.3 | 0.3 | | script.assat.lparse-output | 1.0 | R | 1.0 | 1.0 | 1.1 | | smodels_rsn_slparse | 1.0 | 1.0 | 1.0 | 1.0 | 1.1 | | clasp_slparse_def | 1.1 | 1.1 | 1.1 | 1.1 | 1.2 | | smodels_rs_slparse | 1.1 | 1.0 | 1.0 | 1.0 | 1.1 | | nomore-default-slparse | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | | nomore-D-slparse | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | | nomore-localprop-slparse | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | | clasp_cmp_slparse | 1.1 | 1.1 | 1.1 | 1.1 | 1.1 | | clasp_cmp_slparse2 | 1.1 | 1.0 | 1.1 | 1.1 | 1.1 | | smodels_slparse | 1.1 | 1.1 | 1.0 | 1.1 | 1.1 | | gnt_slparse | 2.5 | 13.2 | 96.4 | 302.8 | R | | dencode_bc+gnt_slparse | 2.5 | 13.2 | 96.3 | 303.3 | R | | dencode+gnt_slparse | 2.5 | 13.3 | 96.4 | 302.9 | R | | pbmodels-minisat+-SLparse | 5.5 | 5.5 | 5.5 | 5.5 | 5.6 |
SolitaireBackward2
|
|
| nomore-default-slparse | R | R | R | R | R | | nomore-D-slparse | R | 35.0 | R | R | R | | nomore-localprop-slparse | R | R | R | R | R | | pbmodels-wsatcc-SLparse | R | R | R | R | R | | clasp_slparse_def | R | 123.0 | R | R | R | | clasp_cmp_slparse | R | 14.6 | 123.2 | R | R | | clasp_cmp_slparse2 | R | R | R | R | R | | smodels_slparse | R | R | R | R | R | | smodels_rs_slparse | R | R | R | R | R | | smodels_rsn_slparse | R | R | R | R | R | | groundedDefault | R | R | R | R | R | | scriptEloopGr | R | R | R | R | R | | scriptAtomreasonGr | R | R | R | R | R | | script.assat.lparse-output | CR | CR | CR | CR | CR | | gnt_slparse | CR | CR | CR | CR | CR | | dencode+gnt_slparse | CR | CR | CR | CR | CR | | dencode_bc+gnt_slparse | CR | CR | CR | CR | CR | | pbmodels-minisat+-SLparse | 47.6 | 5.3 | 62.4 | 105.8 | 330.9 | | pbmodels-pueblo-SLparse | 225.5 | 43.6 | R | R | R |
|