Summary of all benchmark classes in the MGS competition

This section presents the results for the benchmark classes of the First Answer Set Programming System Competition.
Each single run was limited to 600 seconds execution time and 448 MB RAM memory usage.
For the sake of completeness, we provide similar data for all benchmarks used in each competition class. In addition, the tables give the number of instances selected from each class ("#") and provide additional information on the satisfiable and unsatisfiable instances.

Results for SAT and UNSAT instances

Benchmark Class	#	Solved	%	SAT	%	UNSAT	%	min	max	avg
Sokoban	8	16/16	100.00	6/6	100.00	10/10	100.00	12.66	109.52	54.39
Weighted Spanning Tree	8	89/127	70.08	89/127	70.08	0/0		0.06	579.10	115.27
Social Golfer	8	75/120	62.50	59/75	78.67	16/45	35.56	0.23	579.09	40.34
Bounded Spanning Tree	8	73/127	57.48	73/127	57.48	0/0		0.23	519.09	65.47
Towers Of Hanoi	8	71/136	52.21	71/136	52.21	0/0		1.74	584.31	101.10
Blocked N-Queens	8	60/120	50.00	44/75	58.67	16/45	35.56	6.50	542.64	181.69
Hamiltonian Cycle	8	64/150	42.67	64/150	42.67	0/0		0.88	453.88	57.46
Weighted Latin Square	8	41/120	34.17	22/45	48.89	19/75	25.33	0.12	477.67	93.04
Weight Bounded Dominating Set Suite	8	42/127	33.07	42/127	33.07	0/0		0.83	563.39	127.87
Schur Numbers	8	32/120	26.67	18/90	20.00	14/30	46.67	3.27	468.79	120.96
15-Puzzle	7	24/105	22.86	24/105	22.86	0/0		52.91	579.14	291.20
Car Sequencing	8	25/120	20.83	24/105	22.86	1/15	6.67	0.69	563.52	106.08
Fastfood	8	19/127	14.96	8/64	12.50	11/63	17.46	5.30	352.11	113.08
Traveling Salesperson Suite	8	16/128	12.50	16/128	12.50	0/0		0.72	11.18	2.17
Reachability	8	8/160	5.00	6/120	5.00	2/40	5.00	0.26	169.90	49.48

Results for SAT instances only

Benchmark Class	#	Solved	%	min	max	avg
Sokoban	3	6/6	100.00	12.66	77.66	41.83
Social Golfer	5	59/75	78.67	0.86	193.89	15.75
Weighted Spanning Tree	8	89/127	70.08	0.06	579.10	115.27
Blocked N-Queens	5	44/75	58.67	6.50	540.51	185.99
Bounded Spanning Tree	8	73/127	57.48	0.23	519.09	65.47
Towers Of Hanoi	8	71/136	52.21	1.74	584.31	101.10
Weighted Latin Square	3	22/45	48.89	0.12	346.24	60.28
Hamiltonian Cycle	8	64/150	42.67	0.88	453.88	57.46
Weight Bounded Dominating Set Suite	8	42/127	33.07	0.83	563.39	127.87
Car Sequencing	7	24/105	22.86	0.69	563.52	110.05
15-Puzzle	7	24/105	22.86	52.91	579.14	291.20
Schur Numbers	6	18/90	20.00	3.27	468.79	178.16
Traveling Salesperson Suite	8	16/128	12.50	0.72	11.18	2.17
Fastfood	4	8/64	12.50	5.30	92.46	27.06
Reachability	6	6/120	5.00	5.94	169.90	65.84

Results for UNSAT instances only

Benchmark Class	#	Solved	%	min	max	avg
Sokoban	5	10/10	100.00	13.60	109.52	61.92
Schur Numbers	2	14/30	46.67	6.73	281.37	47.42
Social Golfer	3	16/45	35.56	0.23	579.09	130.98
Blocked N-Queens	3	16/45	35.56	12.30	542.64	169.87
Weighted Latin Square	5	19/75	25.33	0.34	477.67	130.98
Fastfood	4	11/63	17.46	8.98	352.11	175.64
Car Sequencing	1	1/15	6.67	10.92	10.92	10.92
Reachability	2	2/40	5.00	0.26	0.50	0.38