TABLIX(1)
NAME
tablix2_benchmark - Tablix benchmark utility
SYNOPSIS
tablix2_benchmark benchmark [ options ] " Tablix options " file
DESCRIPTION
Tablix is a powerful free software kernel for solving general timetabling
problems. It uses a coarse-grained parallel genetic algorithm in combination
with other techniques to construct sensible timetables from XML formatted
problem descriptions. Tablix can run on a single host as well as on a heterogeneous parallel virtual machine using PVM3.
tablix2_benchmark is used to test the effect of different Tablix command line
options on the final result. In most tests Tablix is started multiple times
with the same input file to provide more reliable results. Each time Tablix is
started, three variables are measured: the fitness value of the resulting
timetable, serial number of the last generation and elapsed time (in seconds).
When a test is finished, the average for each variable, as well as the maximum
and minimum values are printed on standard output. The exact format depends on
each test.
The actual timetables that are generated during these tests are stored under a
temporary file names in the current directory and are deleted after
tablix2_benchmark exits.
In some cases tests can take several days to complete. Because the genetic
algorithm can in some cases go into an endless loop, it is always advisable to
limit Tablix execution time with the -t option. This way at least the maximum
execution time for a test can be calculated. tablix2_benchmark will detect
when the time limit set by the -t option was reached. This information will be
included in the final statistics.
OPTIONS
- The following tests are supported:
tablix2_benchmark --single "OPTIONS" file Execute a single Tablix run using and print the results. OPTIONS parameter is mandatory and contains options that will be passed to the tablix2 process. - tablix2_benchmark --multiple N "OPTIONS" FILE Execute N Tablix runs and print the statistics. OPTIONS parameter is mandatory and contains options that will be passed to the tablix2 process.
- tablix2_benchmark --graph START STEP STOP "OPTIONS" FILE Execute multiple Tablix runs. The character " N " in OPTIONS is substituted for an integer that is changed from START to STOP by STEP . Output is gnuplot friendly.
- tablix2_benchmark --multi-graph M START STEP STOP "OPTIONS" FILE Execute multiple Tablix runs. The character " N " in OPTIONS is substituted for an integer that is changed from START to STOP by STEP . M Tablix runs are executed for each value of N . Output is gnuplot friendly (use errorbars).
EXAMPLES
- The following test can be for example used to see the minimum grade, that can
be reached with this configuration file:
tablix2_benchmark --multiple 5 "-t 90 -n 5" sample.xml - Tablix will be started five times. Each time with five computing nodes and
- with 90 minute time limit.
- tablix2_benchmark can also provide useful data for developers. Following test
- can be used to check the effect of the number of computing nodes on the total
- time required to obtain the result:
- tablix2_benchmark --multi-graph 5 1 1 10 "-t 90 -n N" sample.xml >
- stats.txt
- Tablix will be started 50 times. 5 times for each value of N (which in this
- case means the number of nodes). Ten values of N will be probed: from 1 to 10
- with steps of 1. The output will be redirected to stats.txt . A graph of aver
- age computing time versus number of nodes can then be produced in gnuplot with
- the following command:
- plot "test.txt" using ($1):($8):($9):($10) with yerrorbars
BUGS
tablix2_benchmark utility depends on a number of common UNIX programs (mktemp,
grep, sed, awk, ...) that may not be available on all systems. The script is
not currently capable of properly detecting if any required programs are missing.
AUTHOR
Tomaz Solc (tomaz.solc@tablix.org)
SEE ALSO
tablix2(1), Tablix User's Manual, Tablix modules HOWTO, Tablix on Morphix