The TTEST script knows several operation modes: "run", "check", "list", "clean", "realclean", and "validate", controlled by its options. The "run" mode is default and means that the test calculations are performed and the results are written to the TESTPROTOKOLL file. The "check" mode differs only in that the programs are not executed, but the existing program output is checked against the reference. The results of the check are written to the CHECKPROTOKOLL file. Calling the test script in the "list" mode simply lists the test examples that are currently available. This allows the user to save the full list to file, edit, and re-use it with the -r option. The "clean" and "realclean" options are for cleaning up the test directories and protocols. Finally, the "validate" mode is mainly of use for writing the CRIT files. It helps to verify the match patterns provided in the test criteria and shows if it extracts the expected data for comparison with the reference. For every output file used for testing, the "validate" option produces a copy with an additional .val extension. The match strings evaluated for test criteria are highlighted in the output by ««< and »»> marks.
There is a lot of options controlling the behavior of TTESTṪesting specific versions of TURBOMOLE modules is provided by loading path options, -l for binaries, -ls for scripts, and -x for a specific executable. For benchmarking, you need the –timings option to produce the timing summaries, and the –newref option to save the current program timings as the new reference. The module specifications and –short, –long, and -r options can be used for selecting the test examples. The more specialized options are summarized in the following table. Note that most of these options can also be set in the DEFCRIT file (see below).
| Operation modes
| |
| –help | Prints out the help message and exits. |
| -h |
|
| -? | |
| –list | Lists the available test examples. |
| –clean | Deletes the test directories and summary files for the current architecture (given by SYSNAME, see Chapter 1.5). |
| –realclean | Deletes all test directories and protocols. |
| –check dir | Checks the correctness of an existing program test in the directory dir (default: TESTDIR.sysname). Useful if new criteria or new references are established. |
| –validate dir | Examines the output files in the directory dir |
| -val dir | (default: TESTDIR.sysname) and highlights the positions of the retrieved matches. |
| Loading path and naming options
| |
| –loaddir dir | Loading path for the TURBOMOLE binaries |
| -l dir | (default: $TURBODIR/bin/sysname). |
| –scriptdir dir | Loading path for the TURBOMOLE scripts |
| -ls dir | (default: $TURBODIR/scripts). |
| –testprog prog | Tests the given executable prog. |
| -x prog |
|
| –dir dir | Name for the local test directory |
| (default: TESTDIR.sysname). |
|
| –critfile file | Name for the local criteria file |
| (default: CRIT). |
|
| –defcritfile file | Name for the test suite settings file |
| (default: DEFCRIT). |
|
| –protfile file | Name for the local protocol file |
| –output file | (default: TESTPROTOKOLL). |
| –gprotfile file | Name for the global protocol file |
| (default: TESTPROTOKOLL.sysname). |
|
| –checkfile file | Name for the check protocol file |
| (default: CHECKPROTOKOLL). |
|
| –errfile file | Name for the local error output file |
| (default: output.err). |
|
| –probfile file | Name for the failed tests list |
| (default: PROBLEMS.sysname). |
|
| –timfile file | Name for the timings file |
| (default: TIMINGS.sysname). |
|
| –valfile file | Name for the validation file for ’run’ |
| criteria (default: RUNCRIT.val). |
|
| Execution options
| |
| –short | Only short / long subdirectories of the |
| –long | test suite will be tested (default: –short –long). |
| –restart file | The list of test examples for execution will |
| -r file | be read in from file |
| (default: PROBLEMS.sysname). |
|
| –newref string | Produces new reference timings and writes them to the CRIT file. A short description of the reference platform is provided by string. |
| –fileref | Produces new reference files. |
| –batchmode | Running in batch mode, no screen output. |
| –errorstop | Stops / Does not stop after the first error. |
| –noerrorstop | (default: –noerrorstop). |
| –timings | Writes / Does not write the timings on file for |
| –notimings | further processing. (default: –notimings). |
| –runopts | Sets the conditions under which the test is run |
| -o | (default: "sequential, parallel") |