MiniZinc model Instance eclipse_fd[score] eclipse_ic[score] g12_fd[score] gecode[score]
debruijn_binary.mzn 02_03.dzn Abort 0.23s 52.8 0.54s 47.2 Abort
02_07.dzn Abort 1.73s 45.8 0.94s 54.2 Abort
02_08.dzn Abort 7.47s 34.1 0.89s 65.9 Abort
02_09.dzn Abort 34.18s 28.6 1.73s 71.4 Abort
02_10.dzn Abort 167.43s 27.8 9.09s 72.2 Abort
03_06.dzn Abort 39.09s 18.1 4.49s 27.0 0.49s 54.9
03_07.dzn Abort Out of Memory Time Out 2.98s 100.0
03_08.dzn Abort Out of Memory Time Out Time Out
04_06.dzn Abort Out of Memory Time Out Abort
04_07.dzn Abort Out of Memory Time Out Abort
04_08.dzn Abort Out of Memory Abort Abort
nmseq.mzn 020.dzn 0.65s 31.2 Abort 0.99s 28.7 0.03s 40.0
040.dzn 7.89s 21.5 Abort 2.85s 27.9 0.27s 50.6
060.dzn 48.61s 27.2 Abort Time Out 1.27s 72.8
080.dzn 182.41s 18.0 Abort 47.27s 21.7 4.51s 60.4
100.dzn 473.98s 26.6 Abort Time Out 14.51s 73.4
150.dzn Time Out Time Out Time Out 102.79s 100.0
200.dzn Time Out Time Out Time Out 330.92s 100.0
300.dzn Time Out Time Out Time Out Time Out
400.dzn Time Out Time Out Time Out Time Out
500.dzn Out of Memory Out of Memory Time Out Time Out
pentominoes-int.mzn 01.dzn 0.28s 25.7 0.50s 23.8 0.96s 21.1 0.00s 29.4
02.dzn 17.02s 19.6 429.18s 16.8 Time Out 0.14s 63.6
03.dzn 1.98s 21.4 4.27s 17.5 1.73s 22.2 0.01s 38.8
04.dzn Time Out Out of Memory Time Out 186.19s 100.0
05.dzn 296.44s 25.8 Time Out Time Out 4.00s 74.2
06.dzn 13.38s 20.6 200.04s 16.9 Time Out 0.23s 62.5
07.dzn Time Out Time Out Time Out 37.33s 100.0
quasigroup7.mzn 05.dzn 0.82s 22.8 1.23s 20.9 0.52s 24.9 0.00s 31.3
06.dzn 7.40s 15.8 11.22s 14.7 0.57s 29.9 0.01s 39.6
07.dzn 140.48s 12.7 206.94s 12.7 0.60s 33.7 0.19s 40.9
08.dzn Time Out Time Out 1.01s 59.4 3.42s 40.6
09.dzn Time Out Time Out 0.60s 50.3 0.64s 49.7
10.dzn Time Out Time Out Time Out Time Out
11.dzn Time Out Time Out Time Out Time Out
12.dzn Time Out Time Out Time Out Time Out
13.dzn Time Out Time Out Time Out Time Out
14.dzn Time Out Time Out Time Out Time Out
radiation.mzn 01.dzn Abort 22.15s 22.6 5.45s 38.0 5.05s 39.4
02.dzn Abort Time Out 811.47s 100.0 Time Out
03.dzn Abort Time Out 233.47s 56.2 386.68s 43.8
04.dzn Abort 26.73s 21.8 6.51s 35.8 4.59s 42.4
05.dzn Abort 1.17s 29.0 1.00s 30.0 0.10s 41.0
06.dzn Abort 11.77s 24.0 3.40s 38.0 3.41s 38.0
07.dzn Abort 21.40s 21.8 5.58s 34.3 3.26s 43.9
08.dzn Abort 75.13s 22.6 17.50s 40.9 21.53s 36.6
09.dzn Abort Time Out 567.81s 100.0 Time Out
rcpsp.mzn 00.dzn Abort Abort Time Out Time Out
01.dzn Abort Abort Time Out Time Out
02.dzn Abort Abort 9.22s 100.0 Time Out
03.dzn Abort Abort Time Out Time Out
04.dzn Abort Abort Time Out Time Out
05.dzn Abort Abort Time Out Time Out
06.dzn Abort Abort Time Out Time Out
07.dzn Abort Abort Time Out Time Out
08.dzn Abort Abort Time Out Time Out
09.dzn Abort Abort Time Out Time Out
search_stress.mzn 04_04.dzn 0.32s 24.7 0.38s 24.1 0.56s 22.8 0.01s 28.4
08_04.dzn 143.7s 16.7 208.6s 15.4 32.6s 30.5 23.3s 37.4
08_08.dzn Time Out Time Out Time Out Time Out
shortest_path.mzn 00.dzn 2.24s 27.3 3.36s 24.6 Time Out 0.10s 48.1
01.dzn 2.96s 21.6 4.29s 19.3 19.76s 14.2 0.11s 44.9
02.dzn 3.93s 18.3 1.86s 22.6 3.88s 18.4 0.02s 40.7
03.dzn Time Out Time Out Time Out 892.84s 100.0
04.dzn Time Out Time Out 1.70s 74.8 861.53s 25.2
05.dzn Time Out Time Out Time Out 243.45s 100.0
06.dzn 0.92s 23.7 1.12s 22.7 1.86s 20.0 0.02s 33.6
07.dzn Time Out Time Out Time Out 38.79s 100.0
08.dzn Time Out Time Out Time Out 34.44s 100.0
09.dzn Time Out Time Out Time Out 790.36s 100.0
slow_convergence.mzn 0100.dzn 0.32s 25.2 0.37s 24.7 0.90s 21.3 0.02s 28.9
0200.dzn 0.26s 25.3 0.25s 25.4 0.90s 21.0 0.01s 28.4
0300.dzn 1.44s 23.3 1.96s 21.4 1.73s 22.1 0.27s 33.2
0400.dzn 2.48s 23.0 3.33s 20.9 3.83s 20.0 0.54s 36.1
0500.dzn 3.99s 22.4 5.15s 20.6 6.39s 19.2 0.96s 37.8
0600.dzn 5.72s 22.3 7.47s 20.3 9.96s 18.5 1.50s 38.9
0700.dzn 7.96s 27.4 10.19s 25.2 Time Out 2.12s 47.4
0800.dzn 10.16s 22.2 12.79s 20.4 19.01s 17.9 3.04s 39.4
0900.dzn 13.22s 27.5 16.86s 25.3 Time Out 4.08s 47.1
1000.dzn 16.60s 22.2 20.96s 20.3 30.65s 17.9 5.33s 39.6
trucking.mzn 01.dzn 0.33s 25.0 0.48s 23.7 0.65s 22.6 0.02s 28.8
02.dzn 0.31s 24.9 0.42s 23.9 0.61s 22.6 0.01s 28.6
03.dzn 0.32s 32.3 0.47s 30.7 Time Out 0.02s 36.9
04.dzn 1.42s 23.5 2.95s 19.2 1.82s 22.0 0.17s 35.3
05.dzn 14.28s 19.5 33.33s 15.6 17.24s 18.4 2.14s 46.5
11.dzn Time Out Time Out Time Out 896.96s 100.0
12.dzn Time Out Time Out Time Out 894.85s 100.0
13.dzn Time Out Time Out Time Out 868.75s 100.0
14.dzn Time Out Time Out Time Out 877.71s 100.0
15.dzn Time Out Time Out Time Out 840.88s 100.0
Contestant Total Score
eclipse_fd 787.3
eclipse_ic 938.8
g12_fd 1655.1
gecode 3418.8

These results are based on Eclipse version 5.10, an up-to-date release of Gecode,and the 05-09-2008 trunk version of G12.

Due to the mechanism used by the g12_fd benchmarks, some time-outs reported for G12 are actually out-of-memory failures.

Note that the Eclipse aborts are due to 'instantiation faults' which we believe may be due to a minor bug in the Eclipse implementation of FlatZinc.

The gecode aborts on the rcpsp problems are caused by trying to print out the value of non-ground variables.

Since all submitted solvers either prove optimality or have no competitors (except in one case), scoring is the same for both optimisation problems and satisfaction problems. 50 points are shared equally among the solvers finding a solution to a particular test. A further 50 points are shared according to how quickly a solver found the solution relative to the others (full details are available on the Challenge web page).

On the shortest_path problem 04.dzn, g12_fd claims to have found the optimal result; gecodef also gets a result which it does not claim is optimal, which is an order of magnitude worse. The g12_fd result was tested by feeding it into the gecode solver which confirmed its feasibility.

The files on this page are for MiniZinc version 0.8. Versions of these files for the current version of MiniZinc are available as part of the G12 MiniZinc distribution.