MiniZinc Challenge 2011 Results

Entrants

The entrants for this year (with their descriptions, when provided):

In addition, the challenge organisers entered the following FlatZinc implementations:

As per the challenge rules, these entries are not eligible for prizes, but do modify the scoring results. Furthermore, entries in the FD search category (BProlog, Gecode, JaCoP, Chuffed, CPX and G12/FD) were automatically included in the free search category, while entries in the free search category (Bumblebee, Fzn2smt, SCIP, CBC, CPLEX, Gurobi and promoted FD entries) were automatically included in the parallel search category.

Summary of Results

The results for the MiniZinc Challenge 2011 were

Results Presentation

The slides for the presentation of the results at CP2011 are here in [PDF]

Description of Results

All times are given in seconds.

Scores of 0, 1 and 2 are used in the tables rather than 0, 0.5 and 1.

If a promoted entry does not recognize an option (or states that it is just ignored), times and solutions from the previous category are used for scoring. The suffixes -fd, -free and -par at the end of the solvers names indicate which configuration the solvers were run with.

mzn2fzn was run with the same time and memory limits as the solvers.

In the Status column:

Incorrect answers:

Errors:

Selection:

Select a list of solvers and benchmarks and click on "Compute Results" to score the solvers against each other on the selected benchmarks. The entrants for each of the fd search, free search and parallel search categories can be selected with the corresponding buttons.

Solver selection: Problem selection:

Summary:

Total per problem:

Solver Score
Problem Solver Score

Individual results:

Problem Instance Solver Status Time Objective Score

Global constraint per model

The following table lists the global constraints used by each model in this year's challenge.

Model Global constraints used
bacp
black-hole inverse, alldifferent
carpet-cutting cumulative, diffn
costas-array alldifferent
cyclic-rcpsp cumulative
depot-placement alldifferent
fast-food
fillomino
grid-colouring
nonogram regular
open-stacks alldifferent
pattern-set-mining lex_less
pentominoes regular
prize-collecting
roster at_most, at_least, exactly
ship-scheduling
solbat
table layout
vrp
wwtp_real

The files on this page are for MiniZinc version 1.3.