Summary of all solvers in the SCore-∨ competition

This section presents the results for the solvers/call scripts of the First Answer Set Programming System Competition. The placement of solvers was determined according to the number of instances they solved within the allocated time and space as the primary measure of performance. Running times were used as tie breakers.
Each single run was limited to 600 seconds execution time and 448 MB RAM memory usage.
We give below tables providing a complete placement of all call scripts participating in each competition class. We report for each call script the absolute and relative number of solved instances ("Solved" and "%"), its minimum, maximum, and average run times, where "avg" gives the average run time on all solved instances and "avg²" gives the average run time on all instances, where a timeout is taken as 600 seconds. The last column given the Euclidean distance between the vector of all run times of a call script and the virtually best solver taken to be the vector of all minimum run times.

Results for SAT and UNSAT instances

	Call Script	Solved	%	min	max	avg	avg²	EuclDist
1	dlv-contest-special	54/55	98.18	0.03	258.73	23.59	34.07	279.35
2	dlv-contest	54/55	98.18	0.03	259.97	23.86	34.33	279.44
3	disjGlparseDefault	33/55	60.00	1.06	521.59	54.49	272.69	2631.4
4	dencode+gnt_score	29/55	52.73	2.23	521.51	56.34	313.34	2922.73
5	gnt_score	29/55	52.73	2.21	521.91	56.44	313.4	2922.87
6	dencode_bc+gnt_score	29/55	52.73	2.22	522.63	56.45	313.4	2923.17
7	disjGparseEloop	27/55	49.09	1.21	521.55	33.83	322.06	2978.46
8	disjGparseVerMin	27/55	49.09	1.22	523.40	33.98	322.14	2978.77

Results for SAT instances only

	Call Script	Solved	%	min	max	avg	avg²	EuclDist
1	dlv-contest-special	22/23	95.65	0.35	135.99	24.41	49.44	279.35
2	dlv-contest	22/23	95.65	0.35	135.65	24.69	49.7	279.42
3	disjGparseEloop	18/23	78.26	1.21	521.55	45.85	166.32	1170.96
4	disjGlparseDefault	18/23	78.26	1.21	521.59	45.86	166.32	1170.98
5	disjGparseVerMin	18/23	78.26	1.22	523.40	46.06	166.48	1171.75
6	dencode+gnt_score	18/23	78.26	2.27	324.27	56.37	174.55	1216.5
7	dencode_bc+gnt_score	18/23	78.26	2.25	321.02	56.48	174.63	1217.15
8	gnt_score	18/23	78.26	2.29	327.63	56.57	174.71	1216.7

Results for UNSAT instances only

	Call Script	Solved	%	min	max	avg	avg²	EuclDist
1	dlv-contest-special	32/32	100.00	0.03	258.73	23.02	23.02	0.18
2	dlv-contest	32/32	100.00	0.03	259.97	23.29	23.29	3.41
3	disjGlparseDefault	15/32	46.88	1.06	290.99	64.84	349.14	2356.49
4	gnt_score	11/32	34.38	2.21	521.91	56.23	413.08	2657.59
5	dencode+gnt_score	11/32	34.38	2.23	521.51	56.30	413.1	2657.53
6	dencode_bc+gnt_score	11/32	34.38	2.22	522.63	56.40	413.14	2657.72
7	disjGparseEloop	9/32	28.12	4.92	40.37	9.79	434	2738.62
8	disjGparseVerMin	9/32	28.12	4.91	40.62	9.81	434.01	2738.63