MiniZinc Challenge 2009 Results

Entrants

There were two entrants this year:

In addition, the challenge organisers entered the following three FlatZinc implementations:

As per the challenge rules, these entries are not eligible for prizes, but do modify the scoring results.

Description of Results

Times are in seconds. There are 100 points for each problem instance. In the SCB column: S indicates a solution was found; C indicates a complete search; and B indicates the best solution to an optimisation problem.

A run that records a time of less than 900 seconds without returning a solution or completing its search indicates that the run was aborted for some other reason (e.g., running out of memory).

Some solvers could not run certain problems (e.g., g12_lazyfd could not run fillomino because some model variables are unbounded); these scores are marked -N/A-.

Some solvers produced incorrect results (a summary is available below); these scores are marked -BAD-. unbounded); these scores are marked -N/A-.

Summary of Results

fd_search

sicstus 1651.8
eclipse_ic 322.1
gecode 4008.8
g12_fd 2040.6
g12_lazyfd 1376.6

free_search

sicstus 1841.0
gecode 4535.5
g12_fd 1112.4
g12_lazyfd 2511.1

Detailed Results

fd_search

Problem Instance Solver Time (s) SCB Score
 
black-hole 01 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 1 S 74.4
g12_fd 900 0.0
g12_lazyfd 175 S 25.6
 
black-hole 03 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 0 S 65.0
g12_fd 230 S 16.9
g12_lazyfd 32 S 18.1
 
black-hole 05 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 1 S 74.3
g12_fd 900 0.0
g12_lazyfd 150 S 25.7
 
black-hole 07 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 0 S 74.4
g12_fd 900 0.0
g12_lazyfd 85 S 25.6
 
black-hole 09 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 33 S 66.7
g12_fd 900 0.0
g12_lazyfd 171 S 33.3
 
black-hole 11 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 13 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 0 S 65.4
g12_fd 333 S 16.8
g12_lazyfd 42 S 17.8
 
black-hole 15 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 17 sicstus 3 0.0
eclipse_ic 5 SC 16.1
gecode 0 SC 34.3
g12_fd 0 SC 34.3
g12_lazyfd 7 SC 15.2
 
black-hole 19 sicstus 2 -BAD-
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
fillomino 08 sicstus 8 S 26.6
eclipse_ic 900 0.0
gecode 3 S 38.9
g12_fd 4 S 34.5
g12_lazyfd 0 -N/A-
 
fillomino 11 sicstus 41 S 28.6
eclipse_ic 900 0.0
gecode 17 S 44.6
g12_fd 49 S 26.7
g12_lazyfd 0 -N/A-
 
fillomino 13 sicstus 164 S 27.5
eclipse_ic 900 0.0
gecode 74 S 40.5
g12_fd 115 S 32.1
g12_lazyfd 1 -N/A-
 
fillomino 14 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 485 S 56.5
g12_fd 823 S 43.5
g12_lazyfd 0 -N/A-
 
fillomino 15 sicstus 21 S 29.6
eclipse_ic 900 0.0
gecode 7 S 52.2
g12_fd 183 S 18.2
g12_lazyfd 0 -N/A-
 
fillomino 16 sicstus 68 S 28.9
eclipse_ic 900 0.0
gecode 23 S 51.8
g12_fd 317 S 19.3
g12_lazyfd 0 -N/A-
 
fillomino 17 sicstus 37 S 26.6
eclipse_ic 900 0.0
gecode 10 S 51.1
g12_fd 67 S 22.2
g12_lazyfd 0 -N/A-
 
fillomino 18 sicstus 65 S 29.5
eclipse_ic 900 0.0
gecode 32 S 42.3
g12_fd 72 S 28.2
g12_lazyfd 1 -N/A-
 
fillomino 20 sicstus 21 S 23.9
eclipse_ic 900 0.0
gecode 6 S 39.5
g12_fd 7 S 36.6
g12_lazyfd 0 -N/A-
 
fillomino 21 sicstus 117 S 28.1
eclipse_ic 900 0.0
gecode 61 S 38.4
g12_fd 79 S 33.5
g12_lazyfd 0 -N/A-
 
nonogram non_awful_2 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_awful_4 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_fast_1 sicstus 290 S 13.3
eclipse_ic 900 0.0
gecode 4 S 58.0
g12_fd 300 S 13.3
g12_lazyfd 77 S 15.4
 
nonogram non_fast_10 sicstus 398 S 14.7
eclipse_ic 900 0.0
gecode 24 S 48.0
g12_fd 216 S 16.6
g12_lazyfd 107 S 20.7
 
nonogram non_fast_11 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 6 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_fast_5 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 41 S 63.6
g12_fd 900 0.0
g12_lazyfd 141 S 36.4
 
nonogram non_fast_7 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 150 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_fast_9 sicstus 858 S 18.2
eclipse_ic 900 0.0
gecode 30 S 60.3
g12_fd 900 0.0
g12_lazyfd 283 S 21.4
 
nonogram non_med_2 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 297 S 54.4
g12_fd 900 0.0
g12_lazyfd 426 S 45.6
 
nonogram non_med_4 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 225 S 58.5
g12_fd 900 0.0
g12_lazyfd 456 S 41.5
 
open_stacks gp50by50_1 sicstus 142 SCB 30.2
eclipse_ic 900 0.0
gecode 184 SCB 23.3
g12_fd 92 SCB 46.4
g12_lazyfd 1 -N/A-
 
open_stacks nrwsLarger4_1 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks problem_15_15_1 sicstus 315 SCB 26.8
eclipse_ic 900 0.0
gecode 227 SCB 37.2
g12_fd 235 SCB 35.9
g12_lazyfd 1 -N/A-
 
open_stacks problem_20_10_1 sicstus 4 SCB 19.1
eclipse_ic 74 SCB 1.3
gecode 1 SCB 47.8
g12_fd 2 SCB 31.8
g12_lazyfd 0 -N/A-
 
open_stacks wbo_15_30_1 sicstus 26 SCB 30.2
eclipse_ic 900 0.0
gecode 21 SCB 37.1
g12_fd 24 SCB 32.7
g12_lazyfd 0 -N/A-
 
open_stacks wbo_30_15_1 sicstus 7 SCB 15.6
eclipse_ic 111 SCB 1.1
gecode 2 SCB 41.6
g12_fd 2 SCB 41.6
g12_lazyfd 0 -N/A-
 
open_stacks wbo_30_30_1 sicstus 900 S 38.9
eclipse_ic 900 0.0
gecode 900 SB 61.1
g12_fd 900 0.0
g12_lazyfd 1 -N/A-
 
open_stacks wbop_20_10_1 sicstus 2 SCB 17.4
eclipse_ic 11 SCB 4.3
gecode 1 SCB 26.1
g12_fd 0 SCB 52.2
g12_lazyfd 0 -N/A-
 
open_stacks wbp_20_10_1 sicstus 2 SCB 14.1
eclipse_ic 32 SCB 1.3
gecode 0 SCB 42.3
g12_fd 0 SCB 42.3
g12_lazyfd 0 -N/A-
 
open_stacks wbp_30_10_1 sicstus 6 SCB 19.4
eclipse_ic 117 SCB 1.2
gecode 2 SCB 45.4
g12_fd 3 SCB 34.0
g12_lazyfd 0 -N/A-
 
p1f 03 sicstus 0 SC 28.6
eclipse_ic 1 SC 14.3
gecode 0 SC 28.6
g12_fd 0 SC 28.6
g12_lazyfd 0 -N/A-
 
p1f 04 sicstus 0 SCB 28.6
eclipse_ic 1 SCB 14.3
gecode 0 SCB 28.6
g12_fd 0 SCB 28.6
g12_lazyfd 0 -N/A-
 
p1f 05 sicstus 1 SC 16.7
eclipse_ic 1 SC 16.7
gecode 0 SC 33.3
g12_fd 0 SC 33.3
g12_lazyfd 0 -N/A-
 
p1f 06 sicstus 0 SCB 31.2
eclipse_ic 4 SCB 6.2
gecode 0 SCB 31.2
g12_fd 0 SCB 31.2
g12_lazyfd 0 -N/A-
 
p1f 07 sicstus 1 SC 18.8
eclipse_ic 5 SC 6.2
gecode 0 SC 37.5
g12_fd 0 SC 37.5
g12_lazyfd 0 -N/A-
 
p1f 08 sicstus 1 SCB 29.4
eclipse_ic 900 0.0
gecode 0 SCB 58.8
g12_fd 4 SCB 11.8
g12_lazyfd 1 -N/A-
 
p1f 09 sicstus 1 SC 24.9
eclipse_ic 95 SC 0.5
gecode 0 SC 49.7
g12_fd 1 SC 24.9
g12_lazyfd 0 -N/A-
 
p1f 10 sicstus 21 SCB 33.3
eclipse_ic 900 0.0
gecode 10 SCB 66.7
g12_fd 900 S 0.0
g12_lazyfd 0 -N/A-
 
p1f 11 sicstus 3 SC 20.0
eclipse_ic 900 0.0
gecode 1 SC 40.0
g12_fd 1 SC 40.0
g12_lazyfd 1 -N/A-
 
p1f 12 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
prop_stress 0100 sicstus 2 SC 19.2
eclipse_ic 7 SC 13.4
gecode 3 SC 16.9
g12_fd 0 SC 37.5
g12_lazyfd 8 SC 13.1
 
prop_stress 0200 sicstus 13 SC 25.5
eclipse_ic 47 SC 16.3
gecode 60 SC 15.5
g12_fd 5 SC 42.8
g12_lazyfd 31 0.0
 
prop_stress 0300 sicstus 37 SC 24.9
eclipse_ic 156 SC 15.5
gecode 489 SC 13.5
g12_fd 13 SC 46.1
g12_lazyfd 23 0.0
 
prop_stress 0400 sicstus 78 SC 32.8
eclipse_ic 369 SC 20.1
gecode 900 0.0
g12_fd 41 SC 47.1
g12_lazyfd 20 0.0
 
prop_stress 0500 sicstus 139 SC 66.9
eclipse_ic 723 SC 33.1
gecode 900 0.0
g12_fd 243 0.0
g12_lazyfd 24 0.0
 
prop_stress 0600 sicstus 227 SC 100.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 380 0.0
g12_lazyfd 24 0.0
 
prop_stress 0700 sicstus 347 SC 100.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 157 0.0
g12_lazyfd 26 0.0
 
prop_stress 0800 sicstus 502 SC 100.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 136 0.0
g12_lazyfd 26 0.0
 
prop_stress 0900 sicstus 697 SC 100.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 132 0.0
g12_lazyfd 31 0.0
 
prop_stress 1000 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 183 0.0
g12_lazyfd 30 0.0
 
rectangle-packing rpp05_true sicstus 0 S 21.1
eclipse_ic 1 S 15.6
gecode 0 S 21.1
g12_fd 0 S 21.1
g12_lazyfd 0 S 21.1
 
rectangle-packing rpp09_false sicstus 0 0.0
eclipse_ic 1 S 20.8
gecode 0 S 29.2
g12_fd 0 S 29.2
g12_lazyfd 1 S 20.8
 
rectangle-packing rpp12_true sicstus 1 0.0
eclipse_ic 2 S 19.6
gecode 0 S 33.9
g12_fd 1 S 23.2
g12_lazyfd 1 S 23.2
 
rectangle-packing rpp14_false sicstus 1 0.0
eclipse_ic 3 S 19.6
gecode 1 S 26.8
g12_fd 1 S 26.8
g12_lazyfd 1 S 26.8
 
rectangle-packing rpp15_true sicstus 1 0.0
eclipse_ic 17 S 15.6
gecode 1 S 40.1
g12_fd 9 S 18.0
g12_lazyfd 3 S 26.3
 
rectangle-packing rpp19_false sicstus 1 0.0
eclipse_ic 900 0.0
gecode 280 S 53.3
g12_fd 900 0.0
g12_lazyfd 366 S 46.7
 
rectangle-packing rpp22_true sicstus 2 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
rectangle-packing rpp24_false sicstus 2 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
rectangle-packing rpp26_true sicstus 3 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
rectangle-packing rpp30_false sicstus 4 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
roster chicroster_dataset_11 sicstus 13 SCB 4.5
eclipse_ic 2 -BAD-
gecode 1 SCB 31.8
g12_fd 1 SCB 31.8
g12_lazyfd 1 SCB 31.8
 
roster chicroster_dataset_14 sicstus 14 SCB 3.5
eclipse_ic 2 -BAD-
gecode 0 SCB 52.6
g12_fd 1 SCB 26.3
g12_lazyfd 2 SCB 17.5
 
roster chicroster_dataset_17 sicstus 17 SCB 4.0
eclipse_ic 2 -BAD-
gecode 1 SCB 36.0
g12_fd 1 SCB 36.0
g12_lazyfd 2 SCB 24.0
 
roster chicroster_dataset_3 sicstus 4 SCB 9.1
eclipse_ic 1 -BAD-
gecode 0 SCB 45.5
g12_fd 1 SCB 22.7
g12_lazyfd 1 SCB 22.7
 
roster chicroster_dataset_5 sicstus 5 SCB 7.7
eclipse_ic 1 -BAD-
gecode 0 SCB 46.2
g12_fd 1 SCB 23.1
g12_lazyfd 1 SCB 23.1
 
roster chicroster_dataset_7 sicstus 6 SCB 6.7
eclipse_ic 1 -BAD-
gecode 1 SCB 23.3
g12_fd 0 SCB 46.7
g12_lazyfd 1 SCB 23.3
 
roster chicroster_dataset_8 sicstus 18 SCB 5.7
eclipse_ic 1 -BAD-
gecode 2 SCB 36.3
g12_fd 4 SCB 21.8
g12_lazyfd 2 SCB 36.3
 
roster chicroster_dataset_large_13 sicstus 900 0.0
eclipse_ic 2 -BAD-
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
roster chicroster_dataset_large_15 sicstus 900 0.0
eclipse_ic 1 -BAD-
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
roster chicroster_dataset_large_19 sicstus 900 S 0.0
eclipse_ic 2 -BAD-
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
search_stress2 02_07 sicstus 0 SC 25.0
eclipse_ic 1 0.0
gecode 0 SC 25.0
g12_fd 0 SC 25.0
g12_lazyfd 0 SC 25.0
 
search_stress2 03_06 sicstus 1 SC 19.6
eclipse_ic 1 0.0
gecode 0 SC 26.8
g12_fd 0 SC 26.8
g12_lazyfd 0 SC 26.8
 
search_stress2 04_05 sicstus 0 SC 25.0
eclipse_ic 1 0.0
gecode 0 SC 25.0
g12_fd 0 SC 25.0
g12_lazyfd 0 SC 25.0
 
search_stress2 04_06 sicstus 0 SC 25.0
eclipse_ic 2 0.0
gecode 0 SC 25.0
g12_fd 0 SC 25.0
g12_lazyfd 0 SC 25.0
 
search_stress2 05_05 sicstus 0 SC 29.1
eclipse_ic 900 0.0
gecode 0 SC 29.1
g12_fd 49 SC 12.8
g12_lazyfd 0 SC 29.1
 
search_stress2 05_06 sicstus 0 SC 33.3
eclipse_ic 900 0.0
gecode 0 SC 33.3
g12_fd 900 0.0
g12_lazyfd 0 SC 33.3
 
search_stress2 06_04 sicstus 5 SC 14.0
eclipse_ic 16 SC 11.4
gecode 2 SC 18.1
g12_fd 1 SC 22.1
g12_lazyfd 0 SC 34.3
 
search_stress2 06_05 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 586 SC 16.8
g12_fd 344 SC 16.8
g12_lazyfd 0 SC 66.4
 
search_stress2 06_06 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 0 SC -BAD-
 
search_stress2 07_02 sicstus 0 SC 21.1
eclipse_ic 1 SC 15.6
gecode 0 SC 21.1
g12_fd 0 SC 21.1
g12_lazyfd 0 SC 21.1
 
still_life still_life_5 sicstus 1 SCB 12.5
eclipse_ic 1 SCB 12.5
gecode 0 SCB 25.0
g12_fd 0 SCB 25.0
g12_lazyfd 0 SCB 25.0
 
still_life still_life_6 sicstus 1 SCB 15.8
eclipse_ic 5 SCB 5.3
gecode 0 SCB 31.6
g12_fd 0 SCB 31.6
g12_lazyfd 1 SCB 15.8
 
still_life still_life_7 sicstus 5 SCB 20.7
eclipse_ic 29 SCB 4.1
gecode 2 SCB 41.4
g12_fd 3 SCB 31.1
g12_lazyfd 46 SCB 2.6
 
still_life still_life_9 sicstus 900 0.0
eclipse_ic 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
vrp A-n34-k5.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 39.1
g12_fd 900 S 37.1
g12_lazyfd 900 S 23.7
 
vrp A-n44-k7.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 43.9
g12_fd 900 S 30.0
g12_lazyfd 900 S 26.1
 
vrp A-n55-k9.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 39.4
g12_fd 900 S 36.7
g12_lazyfd 900 S 23.9
 
vrp A-n65-k9.vrp sicstus 900 S 21.7
eclipse_ic 900 0.0
gecode 900 SB 35.3
g12_fd 900 S 22.8
g12_lazyfd 900 S 20.1
 
vrp B-n39-k5.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 33.3
g12_fd 900 SB 33.3
g12_lazyfd 900 SB 33.3
 
vrp B-n50-k8.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 37.3
g12_fd 900 SB 37.3
g12_lazyfd 900 S 25.3
 
vrp B-n64-k9.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 38.8
g12_fd 900 S 37.6
g12_lazyfd 900 S 23.6
 
vrp P-n19-k2.vrp sicstus 900 S 18.4
eclipse_ic 900 0.0
gecode 900 SB 31.9
g12_fd 900 S 28.4
g12_lazyfd 900 S 21.2
 
vrp P-n45-k5.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 42.8
g12_fd 900 S 31.7
g12_lazyfd 900 S 25.6
 
vrp P-n55-k7.vrp sicstus 900 S 0.0
eclipse_ic 900 0.0
gecode 900 SB 37.3
g12_fd 900 SB 37.3
g12_lazyfd 900 S 25.3

free_search

Problem Instance Solver Time (s) SCB Score
 
black-hole 01 sicstus 3 -BAD-
gecode 1 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 03 sicstus 2 -BAD-
gecode 0 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 05 sicstus 2 -BAD-
gecode 1 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 07 sicstus 2 -BAD-
gecode 1 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 09 sicstus 2 -BAD-
gecode 33 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 11 sicstus 2 -BAD-
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 13 sicstus 2 -BAD-
gecode 0 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 15 sicstus 2 -BAD-
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
black-hole 17 sicstus 2 0.0
gecode 0 SC 49.4
g12_fd 1 SC 33.1
g12_lazyfd 38 SC 17.5
 
black-hole 19 sicstus 2 -BAD-
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
fillomino 08 sicstus 9 S 22.5
gecode 3 S 31.4
g12_fd 1 S 46.1
g12_lazyfd 0 -N/A-
 
fillomino 11 sicstus 41 0.0
gecode 18 S 73.1
g12_fd 481 S 26.9
g12_lazyfd 1 -N/A-
 
fillomino 13 sicstus 164 S 26.1
gecode 75 S 37.2
g12_fd 77 S 36.7
g12_lazyfd 0 -N/A-
 
fillomino 14 sicstus 900 0.0
gecode 486 S 100.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
fillomino 15 sicstus 21 S 21.2
gecode 7 S 29.1
g12_fd 2 S 49.7
g12_lazyfd 0 -N/A-
 
fillomino 16 sicstus 68 S 23.6
gecode 23 S 36.7
g12_fd 20 S 39.6
g12_lazyfd 0 -N/A-
 
fillomino 17 sicstus 37 S 36.2
gecode 10 S 63.8
g12_fd 900 0.0
g12_lazyfd 1 -N/A-
 
fillomino 18 sicstus 64 S 41.8
gecode 32 S 58.2
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
fillomino 20 sicstus 21 S 38.3
gecode 7 S 61.7
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
fillomino 21 sicstus 118 S 26.7
gecode 60 S 36.2
g12_fd 57 S 37.2
g12_lazyfd 0 -N/A-
 
nonogram non_awful_2 sicstus 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 213 S 100.0
 
nonogram non_awful_4 sicstus 900 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 159 S 100.0
 
nonogram non_fast_1 sicstus 292 S 17.5
gecode 4 S 62.7
g12_fd 900 0.0
g12_lazyfd 71 S 19.9
 
nonogram non_fast_10 sicstus 401 S 27.8
gecode 23 S 72.2
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_fast_11 sicstus 900 0.0
gecode 6 S 73.2
g12_fd 900 0.0
g12_lazyfd 183 S 26.8
 
nonogram non_fast_5 sicstus 900 0.0
gecode 40 S 64.2
g12_fd 900 0.0
g12_lazyfd 147 S 35.8
 
nonogram non_fast_7 sicstus 900 0.0
gecode 147 S 47.4
g12_fd 900 0.0
g12_lazyfd 119 S 52.6
 
nonogram non_fast_9 sicstus 863 S 26.7
gecode 30 S 73.3
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
nonogram non_med_2 sicstus 900 0.0
gecode 294 S 39.5
g12_fd 900 0.0
g12_lazyfd 119 S 60.5
 
nonogram non_med_4 sicstus 900 0.0
gecode 226 S 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
open_stacks gp50by50_1 sicstus 140 SCB 53.5
gecode 161 SCB 46.5
g12_fd 900 0.0
g12_lazyfd 2 -N/A-
 
open_stacks nrwsLarger4_1 sicstus 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks problem_15_15_1 sicstus 315 SCB 42.1
gecode 229 SCB 57.9
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks problem_20_10_1 sicstus 3 SCB 42.9
gecode 2 SCB 57.1
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks wbo_15_30_1 sicstus 27 SCB 44.0
gecode 21 SCB 56.0
g12_fd 900 0.0
g12_lazyfd 1 -N/A-
 
open_stacks wbo_30_15_1 sicstus 7 SCB 20.0
gecode 1 SCB 80.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks wbo_30_30_1 sicstus 900 S 38.9
gecode 900 SB 61.1
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks wbop_20_10_1 sicstus 2 SCB 40.0
gecode 1 SCB 60.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
open_stacks wbp_20_10_1 sicstus 2 SCB 25.0
gecode 0 SCB 75.0
g12_fd 900 0.0
g12_lazyfd 1 -N/A-
 
open_stacks wbp_30_10_1 sicstus 6 SCB 30.0
gecode 2 SCB 70.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 03 sicstus 0 SC 40.0
gecode 1 SC 20.0
g12_fd 0 SC 40.0
g12_lazyfd 0 -N/A-
 
p1f 04 sicstus 0 SCB 49.1
gecode 0 SCB 49.1
g12_fd 27 SCB 1.8
g12_lazyfd 0 -N/A-
 
p1f 05 sicstus 1 SC 33.3
gecode 0 SC 66.7
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 06 sicstus 0 SCB 50.0
gecode 0 SCB 50.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 07 sicstus 1 SC 33.3
gecode 0 SC 66.7
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 08 sicstus 1 SCB 33.3
gecode 0 SCB 66.7
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 09 sicstus 2 SC 25.0
gecode 0 SC 75.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 10 sicstus 20 SCB 34.4
gecode 10 SCB 65.6
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
p1f 11 sicstus 3 SC 33.3
gecode 1 SC 66.7
g12_fd 900 0.0
g12_lazyfd 1 -N/A-
 
p1f 12 sicstus 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 0 -N/A-
 
prop_stress 0100 sicstus 3 SC 24.3
gecode 4 SC 21.9
g12_fd 1 SC 36.1
g12_lazyfd 8 SC 17.7
 
prop_stress 0200 sicstus 13 SC 29.1
gecode 62 SC 19.4
g12_fd 4 SC 51.5
g12_lazyfd 27 0.0
 
prop_stress 0300 sicstus 37 SC 30.5
gecode 501 SC 17.7
g12_fd 14 SC 51.8
g12_lazyfd 27 0.0
 
prop_stress 0400 sicstus 78 0.0
gecode 900 0.0
g12_fd 40 SC 100.0
g12_lazyfd 25 0.0
 
prop_stress 0500 sicstus 139 SC 100.0
gecode 900 0.0
g12_fd 255 0.0
g12_lazyfd 33 0.0
 
prop_stress 0600 sicstus 226 SC 100.0
gecode 900 0.0
g12_fd 260 0.0
g12_lazyfd 24 0.0
 
prop_stress 0700 sicstus 348 SC 100.0
gecode 900 0.0
g12_fd 161 0.0
g12_lazyfd 36 0.0
 
prop_stress 0800 sicstus 503 SC 100.0
gecode 900 0.0
g12_fd 244 0.0
g12_lazyfd 28 0.0
 
prop_stress 0900 sicstus 697 SC 100.0
gecode 900 0.0
g12_fd 690 0.0
g12_lazyfd 29 0.0
 
prop_stress 1000 sicstus 900 0.0
gecode 900 0.0
g12_fd 217 0.0
g12_lazyfd 44 0.0
 
rectangle-packing rpp05_true sicstus 1 S 21.3
gecode 0 S 30.1
g12_fd 0 S 30.1
g12_lazyfd 2 S 18.4
 
rectangle-packing rpp09_false sicstus 0 0.0
gecode 0 S 33.3
g12_fd 0 S 33.3
g12_lazyfd 0 S 33.3
 
rectangle-packing rpp12_true sicstus 1 0.0
gecode 0 S 58.3
g12_fd 900 0.0
g12_lazyfd 1 S 41.7
 
rectangle-packing rpp14_false sicstus 1 0.0
gecode 1 S 50.0
g12_fd 900 0.0
g12_lazyfd 1 S 50.0
 
rectangle-packing rpp15_true sicstus 1 0.0
gecode 1 S 55.0
g12_fd 900 0.0
g12_lazyfd 2 S 45.0
 
rectangle-packing rpp19_false sicstus 1 0.0
gecode 284 S 25.9
g12_fd 900 0.0
g12_lazyfd 4 S 74.1
 
rectangle-packing rpp22_true sicstus 2 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 6 S 100.0
 
rectangle-packing rpp24_false sicstus 2 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 6 S 100.0
 
rectangle-packing rpp26_true sicstus 3 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 8 S 100.0
 
rectangle-packing rpp30_false sicstus 3 0.0
gecode 900 0.0
g12_fd 900 0.0
g12_lazyfd 11 S 100.0
 
roster chicroster_dataset_11 sicstus 12 SCB 4.7
gecode 0 SCB 60.7
g12_fd 1 SCB 30.3
g12_lazyfd 13 SCB 4.3
 
roster chicroster_dataset_14 sicstus 13 SCB 9.3
gecode 1 SCB 64.8
g12_fd 900 0.0
g12_lazyfd 4 SCB 25.9
 
roster chicroster_dataset_17 sicstus 16 SCB 5.0
gecode 0 SCB 84.5
g12_fd 900 0.0
g12_lazyfd 7 SCB 10.6
 
roster chicroster_dataset_3 sicstus 4 SCB 16.7
gecode 1 SCB 41.7
g12_fd 900 0.0
g12_lazyfd 1 SCB 41.7
 
roster chicroster_dataset_5 sicstus 5 SCB 6.2
gecode 0 SCB 37.5
g12_fd 0 SCB 37.5
g12_lazyfd 1 SCB 18.8
 
roster chicroster_dataset_7 sicstus 6 SCB 9.7
gecode 0 SCB 67.7
g12_fd 900 0.0
g12_lazyfd 2 SCB 22.6
 
roster chicroster_dataset_8 sicstus 18 SCB 8.3
gecode 3 SCB 39.3
g12_fd 900 0.0
g12_lazyfd 2 SCB 52.4
 
roster chicroster_dataset_large_13 sicstus 900 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 S 0.0
 
roster chicroster_dataset_large_15 sicstus 900 0.0
gecode 900 S 24.5
g12_fd 900 0.0
g12_lazyfd 64 SCB 75.5
 
roster chicroster_dataset_large_19 sicstus 900 S 0.0
gecode 900 SB 100.0
g12_fd 900 0.0
g12_lazyfd 900 0.0
 
search_stress2 02_07 sicstus 0 C 0.0
gecode 0 C 0.0
g12_fd 0 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 03_06 sicstus 0 C 0.0
gecode 0 C 0.0
g12_fd 0 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 04_05 sicstus 0 C 0.0
gecode 0 C 0.0
g12_fd 0 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 04_06 sicstus 1 C 0.0
gecode 0 C 0.0
g12_fd 1 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 05_05 sicstus 0 SC 25.0
gecode 0 SC 25.0
g12_fd 0 SC 25.0
g12_lazyfd 0 SC 25.0
 
search_stress2 05_06 sicstus 0 SC 31.5
gecode 0 SC 31.5
g12_fd 7 SC 14.9
g12_lazyfd 1 SC 22.0
 
search_stress2 06_04 sicstus 5 C 0.0
gecode 2 C 0.0
g12_fd 0 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 06_05 sicstus 900 0.0
gecode 590 C 0.0
g12_fd 6 C 0.0
g12_lazyfd 0 S 100.0
 
search_stress2 06_06 sicstus 900 0.0
gecode 900 0.0
g12_fd 790 C 0.0
g12_lazyfd 0 S -BAD-
 
search_stress2 07_02 sicstus 0 SC 25.0
gecode 0 SC 25.0
g12_fd 0 SC 25.0
g12_lazyfd 0 SC 25.0
 
still_life still_life_5 sicstus 0 SCB 25.0
gecode 0 SCB 25.0
g12_fd 0 SCB 25.0
g12_lazyfd 0 SCB 25.0
 
still_life still_life_6 sicstus 1 0.0
gecode 0 SCB 46.2
g12_fd 0 SCB 46.2
g12_lazyfd 5 SCB 7.7
 
still_life still_life_7 sicstus 5 SCB 28.1
gecode 2 SCB 56.2
g12_fd 10 SCB 15.3
g12_lazyfd 395 SCB 0.4
 
still_life still_life_9 sicstus 900 0.0
gecode 900 SB 100.0
g12_fd 900 S 0.0
g12_lazyfd 900 S 0.0
 
vrp A-n34-k5.vrp sicstus 900 S 0.0
gecode 900 S 28.2
g12_fd 900 S 26.7
g12_lazyfd 900 SB 45.1
 
vrp A-n44-k7.vrp sicstus 900 S 0.0
gecode 900 S 28.5
g12_fd 900 S 26.6
g12_lazyfd 900 SB 44.9
 
vrp A-n55-k9.vrp sicstus 900 S 0.0
gecode 900 S 29.3
g12_fd 900 S 26.3
g12_lazyfd 900 SB 44.4
 
vrp A-n65-k9.vrp sicstus 900 S 20.3
gecode 900 S 21.2
g12_fd 900 S 22.9
g12_lazyfd 900 SB 35.6
 
vrp B-n39-k5.vrp sicstus 900 S 0.0
gecode 900 S 26.6
g12_fd 900 S 28.6
g12_lazyfd 900 SB 44.8
 
vrp B-n50-k8.vrp sicstus 900 S 0.0
gecode 900 S 37.9
g12_fd 900 SB 38.6
g12_lazyfd 900 S 23.5
 
vrp B-n64-k9.vrp sicstus 900 S 24.3
gecode 900 SB 29.6
g12_fd 900 S 28.9
g12_lazyfd 900 S 17.3
 
vrp P-n19-k2.vrp sicstus 900 S 20.1
gecode 900 S 25.5
g12_fd 900 S 19.8
g12_lazyfd 900 SB 34.6
 
vrp P-n45-k5.vrp sicstus 900 S 0.0
gecode 900 SB 41.3
g12_fd 900 S 33.9
g12_lazyfd 900 S 24.8
 
vrp P-n55-k7.vrp sicstus 900 S 0.0
gecode 900 S 27.2
g12_fd 900 S 27.1
g12_lazyfd 900 SB 45.8

parallel_search

Problem Instance Solver Time (s) SCB
 
black-hole 01 gecode 0 S
[non-par.]1
 
black-hole 03 gecode 0 S
[non-par.]0
 
black-hole 05 gecode 1 S
[non-par.]1
 
black-hole 07 gecode 0 S
[non-par.]0
 
black-hole 09 gecode 21 S
[non-par.]33
 
black-hole 11 gecode 453
[non-par.]900
 
black-hole 13 gecode 1 S
[non-par.]0
 
black-hole 15 gecode 457
[non-par.]900
 
black-hole 17 gecode 0 SC
[non-par.]0
 
black-hole 19 gecode 463
[non-par.]900
 
fillomino 08 gecode 2 S
[non-par.]3
 
fillomino 11 gecode 4 S
[non-par.]17
 
fillomino 13 gecode 9 S
[non-par.]74
 
fillomino 14 gecode 188 S
[non-par.]485
 
fillomino 15 gecode 2 S
[non-par.]7
 
fillomino 16 gecode 12 S
[non-par.]23
 
fillomino 17 gecode 3 S
[non-par.]10
 
fillomino 18 gecode 17 S
[non-par.]32
 
fillomino 20 gecode 5 S
[non-par.]6
 
fillomino 21 gecode 33 S
[non-par.]61
 
nonogram non_awful_2 gecode 3 S
[non-par.]900
 
nonogram non_awful_4 gecode 6 S
[non-par.]900
 
nonogram non_fast_1 gecode 4 S
[non-par.]4
 
nonogram non_fast_10 gecode 6 S
[non-par.]24
 
nonogram non_fast_11 gecode 4 S
[non-par.]6
 
nonogram non_fast_5 gecode 6 S
[non-par.]41
 
nonogram non_fast_7 gecode 3 S
[non-par.]150
 
nonogram non_fast_9 gecode 16 S
[non-par.]30
 
nonogram non_med_2 gecode 273 S
[non-par.]297
 
nonogram non_med_4 gecode 7 S
[non-par.]225
 
open_stacks gp50by50_1 gecode 165 SCB
[non-par.]184
 
open_stacks nrwsLarger4_1 gecode 452 SB
[non-par.]900
 
open_stacks problem_15_15_1 gecode 121 SCB
[non-par.]227
 
open_stacks problem_20_10_1 gecode 0 SCB
[non-par.]1
 
open_stacks wbo_15_30_1 gecode 14 SCB
[non-par.]21
 
open_stacks wbo_30_15_1 gecode 2 SCB
[non-par.]2
 
open_stacks wbo_30_30_1 gecode 456 SB
[non-par.]900
 
open_stacks wbop_20_10_1 gecode 0 SCB
[non-par.]1
 
open_stacks wbp_20_10_1 gecode 1 SCB
[non-par.]0
 
open_stacks wbp_30_10_1 gecode 1 SCB
[non-par.]2
 
p1f 03 gecode 0 SC
[non-par.]0
 
p1f 04 gecode 0 SCB
[non-par.]0
 
p1f 05 gecode 0 SC
[non-par.]0
 
p1f 06 gecode 0 SCB
[non-par.]0
 
p1f 07 gecode 0 SC
[non-par.]0
 
p1f 08 gecode 0 SCB
[non-par.]0
 
p1f 09 gecode 0 SC
[non-par.]0
 
p1f 10 gecode 11 SCB
[non-par.]10
 
p1f 11 gecode 1 SC
[non-par.]1
 
p1f 12 gecode 459 SB
[non-par.]900
 
prop_stress 0100 gecode 3 SC
[non-par.]3
 
prop_stress 0200 gecode 59 SC
[non-par.]60
 
prop_stress 0300 gecode 506 SC
[non-par.]489
 
prop_stress 0400 gecode 900
[non-par.]900
 
prop_stress 0500 gecode 900
[non-par.]900
 
prop_stress 0600 gecode 900
[non-par.]900
 
prop_stress 0700 gecode 900
[non-par.]900
 
prop_stress 0800 gecode 900
[non-par.]900
 
prop_stress 0900 gecode 900
[non-par.]900
 
prop_stress 1000 gecode 900
[non-par.]900
 
rectangle-packing rpp05_true gecode 0 S
[non-par.]0
 
rectangle-packing rpp09_false gecode 0 S
[non-par.]0
 
rectangle-packing rpp12_true gecode 0 S
[non-par.]0
 
rectangle-packing rpp14_false gecode 0 S
[non-par.]1
 
rectangle-packing rpp15_true gecode 2 S
[non-par.]1
 
rectangle-packing rpp19_false gecode 178 S
[non-par.]280
 
rectangle-packing rpp22_true gecode 459
[non-par.]900
 
rectangle-packing rpp24_false gecode 452
[non-par.]900
 
rectangle-packing rpp26_true gecode 452
[non-par.]900
 
rectangle-packing rpp30_false gecode 453
[non-par.]900
 
roster chicroster_dataset_11 gecode 1 SCB
[non-par.]1
 
roster chicroster_dataset_14 gecode 0 SCB
[non-par.]0
 
roster chicroster_dataset_17 gecode 1 SCB
[non-par.]1
 
roster chicroster_dataset_3 gecode 0 SCB
[non-par.]0
 
roster chicroster_dataset_5 gecode 0 SCB
[non-par.]0
 
roster chicroster_dataset_7 gecode 1 SCB
[non-par.]1
 
roster chicroster_dataset_8 gecode 2 SCB
[non-par.]2
 
roster chicroster_dataset_large_13 gecode 459 SB
[non-par.]900
 
roster chicroster_dataset_large_15 gecode 452
[non-par.]900
 
roster chicroster_dataset_large_19 gecode 453 SB
[non-par.]900
 
still_life still_life_5 gecode 0 SCB
[non-par.]0
 
still_life still_life_6 gecode 0 SCB
[non-par.]0
 
still_life still_life_7 gecode 1 SCB
[non-par.]2
 
still_life still_life_9 gecode 452 SB
[non-par.]900
 
vrp A-n34-k5.vrp gecode 712 SB
[non-par.]900
 
vrp A-n44-k7.vrp gecode 803 SB
[non-par.]900
 
vrp A-n55-k9.vrp gecode 870 SB
[non-par.]900
 
vrp A-n65-k9.vrp gecode 454 SB
[non-par.]900
 
vrp B-n39-k5.vrp gecode 480 SB
[non-par.]900
 
vrp B-n50-k8.vrp gecode 457 SB
[non-par.]900
 
vrp B-n64-k9.vrp gecode 458 SB
[non-par.]900
 
vrp P-n19-k2.vrp gecode 477 SB
[non-par.]900
 
vrp P-n45-k5.vrp gecode 781 SB
[non-par.]900
 
vrp P-n55-k7.vrp gecode 464 SB
[non-par.]900

Erroneous Results

g12_lazyfd could not run fillomino, p1f, or open_stacks because these models contain unbounded variables.

g12_lazyfd incorrectly reports solutions for search_stress2 problems 06_06, 07_07, 08_08, 10_10, 11_11, 12_12, 14_14, and 15_15.

sicstus incorrectly reports unsatisfiability for black-hole problems, except for 17 which is unsatisfiable.

eclipse_ic incorrectly reports unsatisfiability for roster.

Global constraints used in each model

The following table lists the global constraints used by each model in this year's challenge.

Model Global constraints used
black-hole inverse, table
fillomino
nonogram regular
open-stacks all_different
p1f all_different, inverse, lex_less
prop_stress
rectangle-packing cumulative
roster at_least, at_most, exactly
search_stress2
still-life
vrp

Builtin global constraints per FlatZinc solver

The following table lists the global constraints that are provided as builtins by each solver.

Solver Builtin global constraints
ECLiPSe/IC all_different, all_disjoint, at_least, at_most, count, cumulative, disjoint, exactly, link_set_to_booleans, maximum, sort
G12/FD all_different, cumulative
G12/LazyFD all_different
Gecode all_different, among, at_least, at_most, count, cumulative, disjoint, distribute, exactly, increasing, inverse, lex_lesseq, lex_less, maximum, minimum, nvalue, partition_set, regular, sort, sum_pred, table
SICStus all_different, at_least, at_most, cumulative, exactly, global_cardinality, inverse, lex_lesseq, lex_less, maximum, nvalue, sort table

The files on this page are for MiniZinc version 1.0.

Versions of these files for the current version of MiniZinc are available as part of the G12 MiniZinc distribution.