Summary of all benchmarks in the SCore-∨ competition
| 7.3 | call script runs 7.3 seconds on the benchmark instance |
| 1.1 | call script runs 1.1 seconds on the benchmark instance (first place) |
| 1.2 | call script runs 1.2 seconds on the benchmark instance (second place) |
| 2.3 | call script runs 2.3 seconds on the benchmark instance (third place) |
| R | call script runs out of time |
| S | call script runs out of memory |
| I | computed answer set is incorrect |
| NF | answer set was not found (only for incomplete solvers) |
| CR | call script/solver can't read the input format e.g. extended rules |
|
StrategicCompanies
|
|
| dlv-contest-special | 8.6 | 2.9 | 45.1 | 136.0 | 6.4 | 2.1 | 126.8 | 32.1 | 22.2 | 21.1 | 66.6 | 53.4 | R | 0.4 | 0.7 | | dlv-contest | 8.8 | 2.9 | 45.6 | 135.6 | 6.4 | 2.2 | 131.9 | 33.2 | 22.7 | 21.3 | 64.5 | 54.1 | R | 0.4 | 0.7 | | disjGlparseDefault | 10.3 | 30.6 | 521.6 | R | 1.2 | 7.3 | R | 84.6 | 9.0 | R | R | 72.9 | R | 24.1 | 14.7 | | disjGparseEloop | 10.3 | 30.6 | 521.6 | R | 1.2 | 7.3 | R | 84.6 | 9.0 | R | R | 73.1 | R | 24.0 | 14.5 | | disjGparseVerMin | 10.3 | 30.7 | 523.4 | R | 1.2 | 7.3 | R | 84.9 | 9.0 | R | R | 73.0 | R | 25.2 | 14.5 | | dencode_bc+gnt_score | 13.7 | 7.7 | 209.9 | R | 70.3 | 25.6 | R | 55.9 | R | R | R | 246.6 | 321.0 | 6.9 | 2.2 | | dencode+gnt_score | 13.9 | 7.9 | 209.9 | R | 70.2 | 25.6 | R | 54.8 | R | R | R | 242.7 | 324.3 | 6.6 | 2.3 | | gnt_score | 13.9 | 7.7 | 210.3 | R | 69.1 | 25.8 | R | 55.2 | R | R | R | 243.8 | 327.6 | 6.4 | 2.3 |
GrammarBasedInformationExtraction
|
|
| dlv-contest-special | 1.7 | 1.8 | 1.2 | 1.6 | 1.7 | 1.3 | 1.7 | 1.7 | 0.7 | 0.6 | 0.7 | 0.7 | 0.6 | 0.7 | 0.7 | | dlv-contest | 1.7 | 1.8 | 1.2 | 1.6 | 1.7 | 1.4 | 1.7 | 1.7 | 0.7 | 0.6 | 0.7 | 0.7 | 0.6 | 0.7 | 0.8 | | disjGlparseDefault | 6.6 | 6.8 | 4.6 | 5.9 | 6.6 | 5.3 | 6.6 | 6.5 | 5.7 | 5.0 | 5.7 | 5.8 | 4.9 | 5.5 | 5.8 | | disjGparseEloop | 6.6 | 6.8 | 4.6 | 5.9 | 6.7 | 5.3 | 6.6 | 6.5 | 5.7 | 5.0 | 5.7 | 5.8 | 4.9 | 5.5 | 5.8 | | disjGparseVerMin | 6.7 | 6.9 | 4.6 | 6.0 | 6.7 | 5.4 | 6.7 | 6.6 | 5.7 | 5.0 | 5.7 | 5.8 | 4.9 | 5.5 | 5.7 | | gnt_score | 7.6 | 7.8 | 5.2 | 6.8 | 7.6 | 6.1 | 7.6 | 7.4 | 6.8 | 5.9 | 6.7 | 6.8 | 5.8 | 6.5 | 6.8 | | dencode+gnt_score | 7.6 | 7.9 | 5.3 | 6.8 | 7.7 | 6.1 | 7.6 | 7.5 | 6.8 | 5.9 | 6.8 | 6.8 | 5.9 | 6.6 | 6.8 | | dencode_bc+gnt_score | 7.6 | 7.8 | 5.3 | 6.9 | 7.7 | 6.1 | 7.7 | 7.5 | 6.8 | 6.0 | 6.8 | 6.9 | 5.9 | 6.6 | 6.9 |
disjunctiveLoops
|
|
| dlv-contest-special | 1.4 | 0.4 | 65.7 | | dlv-contest | 1.4 | 0.4 | 66.0 | | gnt_score | 40.0 | 9.2 | 521.9 | | disjGparseEloop | 40.4 | 9.4 | S | | dencode_bc+gnt_score | 40.5 | 9.4 | 522.6 | | dencode+gnt_score | 40.5 | 9.4 | 521.5 | | disjGlparseDefault | 40.5 | 9.4 | S | | disjGparseVerMin | 40.6 | 9.4 | S |
Mutex
|
|
| disjGlparseDefault | S | S | 1.1 | S | S | S | S | | disjGparseEloop | S | S | S | S | S | S | S | | disjGparseVerMin | S | S | S | S | S | S | S | | gnt_score | R | R | 2.2 | R | R | R | R | | dencode+gnt_score | R | R | 2.2 | R | R | R | R | | dencode_bc+gnt_score | R | R | 2.2 | R | R | R | R | | dlv-contest-special | 258.7 | 2.8 | 0.0 | 12.6 | 0.1 | 57.0 | 0.5 | | dlv-contest | 260.0 | 2.8 | 0.0 | 12.8 | 0.1 | 57.5 | 0.5 |
RandomQuantifiedBooleanFormulas
|
|
| disjGparseEloop | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | | disjGparseVerMin | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | | gnt_score | R | R | R | R | R | R | R | R | R | R | R | R | R | R | R | | dencode+gnt_score | R | R | R | R | R | R | R | R | R | R | R | R | R | R | R | | dencode_bc+gnt_score | R | R | R | R | R | R | R | R | R | R | R | R | R | R | R | | dlv-contest-special | 1.1 | 0.1 | 7.2 | 0.3 | 5.9 | 12.3 | 4.1 | 23.3 | 12.1 | 12.5 | 13.6 | 40.5 | 112.7 | 49.3 | 37.4 | | dlv-contest | 1.1 | 0.1 | 7.3 | 0.3 | 6.0 | 12.6 | 4.2 | 23.7 | 12.3 | 12.8 | 13.8 | 40.3 | 115.4 | 50.3 | 38.3 | | disjGlparseDefault | 291.0 | 59.8 | R | 147.0 | 109.1 | 276.3 | R | R | R | R | R | R | R | R | R |
|