PAVER 2

This tools is meant to simplify the task of performance data comparison and visualization.

It is available on GitHub: https://github.com/coin-or/Paver.

Some description of it can be found in:

Michael R. Bussieck, Steven P. Dirkse, Stefan Vigerske
PAVER 2.0: An Open Source Environment for Automated Performance Analysis of Benchmarking Data
Journal of Global Optimization, 59:2-3, 259-275 (2014)

Examples

PAVER 2 comes with a number of examples that demonstrate input format and functionality of the scripts.

LP Benchmark I

Input: lp1gen.trc lp2gen.trc lp3gen.trc linlib.solu

PAVER 2 call: python paver.py lp1gen.trc lp2gen.trc lp3gen.trc linlib.solu --writehtml linlib.gen

Output: linlib.gen

LP Benchmark II

Input: A.trc B.trc C.trc linlib.solu

PAVER 2 call: python paver.py A.trc B.trc C.trc linlib.solu --writehtml linlib.all

Output: linlib.all

MIP Benchmark I

Input: gimli.trc bombur.trc thorin.trc bifur.trc balin.trc miplib2010.solu

PAVER 2 call: python paver.py gimli.trc bombur.trc thorin.trc bifur.trc balin.trc miplib2010.solu --failtime 3600 --refsolver Thorin --writehtml miplib2010.all

Output: miplib2010.all

MIP Benchmark II

Input: CBC.trc CPLEX.trc SCIPcpx.trc SCIPspx.trc solve trace files for each solver run miplib2010.solu

PAVER 2 call: python paver.py CBC.trc CPLEX.trc SCIPcpx.trc SCIPspx.trc *.solvetrace miplib2010.solu --failtime 3600 --writehtml miplib2010_slvtrc.all

Output: miplib2010_slvtrc.all

NLP Benchmark I (local solver, disabled Examiner checks)

Input: dasher.trc dancer.trc comet.trc cupid.trc donner.trc globallib.solu

PAVER 2 call: python paver.py dasher.trc dancer.trc comet.trc cupid.trc donner.trc globallib.solu --failtime 3600 --mintime 0.1 --ccopttol inf --ccfeastol inf --writehtml globallib.localExamNo

Output: globallib.localExamNo

NLP Benchmark II (local solver)

Input: dasher.trc dancer.trc comet.trc cupid.trc donner.trc globallib.solu

PAVER 2 call: python paver.py dasher.trc dancer.trc comet.trc cupid.trc donner.trc globallib.solu --failtime 900 --mintime 0.1 --ccopttol 1e-5 --ccfeastol 1e-5 --writehtml globallib.localExamYes

Output: globallib.localExamYes

NLP Benchmark III (local and global solver)

Input: blitzen.trc comet.trc dasher.trc prancer.trc donner.trc globallib.solu

PAVER 2 call: python paver.py blitzen.trc comet.trc dasher.trc prancer.trc donner.trc globallib.solu --failtime 900 --mintime 0.1 --ccopttol inf --ccfeastol 1e-5 --writehtml globallib.global

Output: globallib.global