-
Notifications
You must be signed in to change notification settings - Fork 462
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Regression Test #23
Closed
Closed
Regression Test #23
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…e generated locally for testing only
… requirement for running make install
…g the python interpreter
… the reg test commands
… listed python requirement to Python 3.0+
…ently of openfast
…icit input arguments and build fewer directory paths internally
ghost
closed this
May 26, 2017
ghost
mentioned this pull request
Apr 16, 2019
Closed
Closed
Open
psakievich
pushed a commit
to psakievich/openfast
that referenced
this pull request
Aug 3, 2023
Add hub and nacelle ref orient
andrew-platt
pushed a commit
that referenced
this pull request
Mar 11, 2024
UA driver bug fix: sim mod 2
This pull request was closed.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This pull request adds a simple regression test borrowing heavily from @jrood-nrel's Nalu regression test and @gantech's fastCPPtests.
The test configuration is handled with CTest, so the test is only built if the appropriate CMake flag,
ENABLE_TESTS
, isON
.The regression test itself is driven by
reg_tests/executeRegressionTestCase.py
which runs the OpenFAST test case and compares the binary output to the "gold standard" withreg_tests/pass_fail.py
. The pass/fail criteria is a comparison of the variance of each channel in the binary output file with a predetermined tolerance. The tolerance is automatically picked by CMake based on machine and compiler type.The test data is included in a submodule called RegressionTestData which based on the CertTest directory in FAST v8. This repository has two subdirectories:
inputs
andoutputs
. The contents ofinputs
are used in CTest configuration and the contents ofoutputs
are the "gold standard" solutions. There is also a python scriptrunCertTestsLocally.py
which executes all of the cases ininputs
in a new directoryoutputs-local
.To run the test from a fresh clone:
git clone https://github.com/rafaelmudafort/openfast.git
cd openfast
git checkout dev
git submodule update --init --recursive
mkdir build
cd build
ccmake .. # or otherwise configure cmake flags
-- hit c, then e
-- turn on the test boolean, configure the install prefix, etc
-- hit c, then e
-- again hit c, then e
-- hit g
make
make test
Improvements to come: