Starting with AOCL 5.2, the AOCL-LAPACK test suite includes functionality to verify both repeatability and reproducibility of API results between different runs and configurations.
- These tests are run in two phases:
1. Ground Truth (GT) phase: Inputs for tests are stored in binary files. Runs tests and validates the outputs generated from the APIs. Outputs for tests are stored in binary files or CRC checksum can be used for large data.
2. Verification phase: Loads the previously stored inputs from binary files (GT phase) and runs the tests. Outputs generated from the APIs are verified against the outputs from GT for bit exactness.
- Different tests in BRT:
1. Reproducibility Testing: Run GT phase in one configuration, verification phase in a different configuration (different builds, environments).
2. Repeatability Testing: Run both phases in the same configuration to verify consistent results across multiple runs.