Code

Regression Test#23

Code

Closed

ghost wants to merge 132 commits intoOpenFAST:devOpenFAST/openfast:devfrom rafmudaf:devrafmudaf/openfast:devCopy head branch name to clipboard

+886-3

Commits

Commits on May 1, 2017

• add the initial regression testing files and script for Test01

  rafmudaf

  committed
  fb6b74e

• enable ctest in through cmake

  rafmudaf

  committed
  5eaecd4

• gitignore the install directory

  rafmudaf

  committed
  3f11b84

• wire shell and python scripts to compare Test01 local and gold standard

  rafmudaf

  committed
  d780845

• gitignore .pyc

  rafmudaf

  committed
  a9a3d4a

• add the cmake and ctest configs to reg_tests

  rafmudaf

  committed
  1cdb41b

• add sim links to some required data directories

  rafmudaf

  committed
  d713f83

• cleanup the build/reg_tests directory structure

  rafmudaf

  committed
  ed20dad

• pass the tolerance through to the python script from the cmake config

  rafmudaf

  committed
  7e5954e

• update the baseline input files and solution files; NOTE: .outb's were generated locally for testing only

  rafmudaf

  committed
  dc82e3e

• add baseline binary output and required 5MW data directory

  rafmudaf

  committed
  a8ff7d1

• add required AOC directory

  rafmudaf

  committed
  e5b1188

• write out binary .out for all tests

  rafmudaf

  committed
  92f2949

• include more required files for CertTest cases

  rafmudaf

  committed
  9aaed62

• include the sim link for required files in CertTest cases

  rafmudaf

  committed
  0d64449

• enable all CertTest cases

  rafmudaf

  committed
  34b0fe0

Commits on May 2, 2017

• copy the source input files and solution directly from CertTest with binary output on

  rafmudaf

  committed
  e04627e

• add more descriptive comments

  rafmudaf

  committed
  2ef8b90

• add more descriptive comment

  rafmudaf

  committed
  ac3d4df

• set tolerance for windows; code cleanup

  rafmudaf

  committed
  03bd836

• improve argument validation and error handling

  rafmudaf

  committed
  0b0492c

• bug fix on machine/compiler check

  rafmudaf

  committed
  f65f07e

• remove the extraneous shell script in favor of the python comparison script

  rafmudaf

  committed
  ff40c83

• rename pass/fail python script

  rafmudaf

  committed
  26726a0

• allow comparison of ascii to binary output files

  rafmudaf

  committed
  af0f26d

• use the compiled binary rather than the installed binary to avoid the requirement for running make install

  rafmudaf

  committed
  fdef7e8

• extract regression test files to a git submodule

  rafmudaf

  committed
  eca7522

• remove executable bit on python script since it will be run by calling the python interpreter

  rafmudaf

  committed
  a3a85f7

• Merge branch 'dev' into feature/add-submodule

  rafmudaf

  committed
  8f35721

• added the RegressionTestData repo as a submodule

  rafmudaf

  committed
  da34aab

• bug fix on ctest config

  rafmudaf

  committed
  0b4fd2a

• bug fix on ctest config

  rafmudaf

  committed
  9a083e1

• reroute ctest config after including submodule

  rafmudaf

  committed
  11db334

• bug fix on ctest directory structure config

  rafmudaf

  committed
  d1dde90

Commits on May 3, 2017

• Merge branch 'feature/add-submodule' into dev

  rafmudaf

  committed
  35bb734

• update RegressionTestData submodule to its latest HEAD

  rafmudaf

  committed
  ea1ff86

• update submodule HEAD to latest

  rafmudaf

  committed
  2857c59

• update the failure exit code to a positive non 0 number -> 1

  rafmudaf

  committed
  33f7a50

• update ctest configuration after regression test directory structure update

  rafmudaf

  committed
  bfd725b

Commits on May 4, 2017

• replace bash execution of regression test with a python script to do the same

  rafmudaf

  committed
  6805f75

• update submodule to latest HEAD

  rafmudaf

  committed
  8eac312

• add tests 20-26

  rafmudaf

  committed
  1305b32

• replace unused code from development with a more descriptive TODO

  rafmudaf

  committed
  5f4029a

• Merge remote-tracking branch 'upstream/dev' into dev

  rafmudaf

  committed
  0b5dd55

• use the cmake intrinsic 'file(COPY' rather than 'execute_process' to copy input data files

  rafmudaf

  committed
  6348088

• reference the regression test script directly in the reg_tests directory rather than copying to /build

  rafmudaf

  committed
  de948b9

• add better argument checking and error handling; run openfast before checking if the solution files exists

  rafmudaf

  committed
  1179730

• update submodule to latest HEAD

  rafmudaf

  committed
  f98ce39

Commits on May 5, 2017

• update submodule to latest HEAD

  rafmudaf

  committed
  b1687a3

• check for Fortran compiler not CXX compiler type in CTest

  rafmudaf

  committed
  23d2521

Commits on May 8, 2017

• remove the Clang check, theres no clang fortran compiler

  rafmudaf

  committed
  4f80719

• rename RegressionTestData -> r-test in gitmodule

  rafmudaf

  committed
  e091ab3

• remote the RegressionTestData repo from submodules

  rafmudaf

  committed
  4d922dd

• add r-test submodule referencing the openfast/r-test repo

  rafmudaf

  committed
  6e6e5f1

• specify a branch in the r-test submodule

  rafmudaf

  committed
  9e97af9

Commits on May 10, 2017

• update CMake input files with new regression test data repo name

  rafmudaf

  committed
  edc555c

• add ctest config files and the steering script

  rafmudaf

  committed
  22f92aa

• gitignore the ctest-build directory

  rafmudaf

  committed
  91428d2

• remove debug print statement

  rafmudaf

  committed
  a2850ba

• add more genericness to the python scripts to ensure cross platform and cross installation compatibility

  rafmudaf

  committed
  a6d3019

• add configuration for a local cdash to ctest

  rafmudaf

  committed
  30083a2

• update test list file

  rafmudaf

  committed
  6bff453

• configure the steering script for local cdash and to execute the tests

  rafmudaf

  committed
  af5872c

• add support for multiple solution sets, and automatically choose the appropriate one based on machine type and compiler

  rafmudaf

  committed
  b6109aa

• add all certtest cases to the test file

  rafmudaf

  committed
  e946b12

• remove unnecessary configurations in ctestconfig; keep file to suppress a ctest warning when it doesnt find config file

  rafmudaf

  committed
  aee3904

• customize steering script for only running the test -> remove the build and dashboard stuff

  rafmudaf

  committed
  51301bb

Commits on May 11, 2017

• use a variable for the openfast executable in ctest

  rafmudaf

  committed
  b205a62

• check for a given openfast executable when running ctest independently

  rafmudaf

  committed
  725678d

• add a driver to run ctest independently

  rafmudaf

  committed
  3e8e7fb

• updates for windows support

  rafmudaf

  committed
  d27f332

• convert paths to cmake style

  rafmudaf

  committed
  5ec4fb8

• revert a bug fix that wasnt actually a bug fix

  rafmudaf

  committed
  12c2039

• automatically determine the test tolerance and leave the option for user specification

  rafmudaf

  committed
  6135421

• Merge branch 'feature/ctest-without-cmake' into feature/goldstandard-expansion

  rafmudaf

  committed
  c1d91d8

• fix merge conflicts: move submodule to corresponding feature branch

  rafmudaf

  committed
  e87545c

• add support for optional system and compiler types to the regression test python script

  rafmudaf

  committed
  43fc58d

• Merge remote-tracking branch 'upstream/dev' into dev

  rafmudaf

  committed
  a769c1f

• rename script to manually execute the regression test

  rafmudaf

  committed
  6f91311

• update submodule to latest HEAD; rework scripts for updated submodule

  rafmudaf

  committed
  37d4dbe

Commits on May 12, 2017

• upgrade r-test submodule to a feature branch

  rafmudaf

  committed
  647bc5f

• move submodule remote off of the openfast repo while in development

  rafmudaf

  committed
  31c1916

• bug fix in parsing input variables

  rafmudaf

  committed
  a845e13

• update call signature to regression test python script

  rafmudaf

  committed
  8a977cf

• update submodule to latest HEAD

  rafmudaf

  committed
  543fdd5

• update submodule to latest HEAD

  rafmudaf

  committed
  b92b7f7

Commits on May 15, 2017

• extend the timeout to 25 minutes, some of the higher cert test cases take longer than 15 minutes to finish

  rafmudaf

  committed
  649d8ba

• update the doc strings of the python programs to more consistent and meaningful language

  rafmudaf

  committed
  7a134f8

• add a README to the reg_tests directory

  rafmudaf

  committed
  69c35ac

• include info on running the regression test in the reg_tests README

  rafmudaf

  committed
  f2856b1

• add a docstring

  rafmudaf

  committed
  9d94fe2

• typo fixes and updates to the README

  rafmudaf

  committed
  fcd90ee

• typo fix to the README

  rafmudaf

  committed
  27dc954

• updates to docstrings and the reg_tests README for better clarity

  rafmudaf

  committed
  3c7608c

• update the sphinx documentation with automated testing description and procedures

  rafmudaf

  committed
  03bb880

• rename r-test gold standard directory from rhel-intel to linux-intel

  rafmudaf

  committed
  1f346f6

• better handling for system-compiler combinations that dont exist in gold standards; improved comments and doc string

  rafmudaf

  committed
  9724970

Commits on May 16, 2017

• update submodule to latest HEAD

  rafmudaf

  committed
  dfeb059

• use intrinsic cmake options for including ctest

  rafmudaf

  committed
  5fbb51d

• use more explicit input argument for python script call; refactor code for clarity

  rafmudaf

  committed
  3ef59e8

• remote print statement for debugging

  rafmudaf

  committed
  633d7df

• compile the 5MW ServoDyn controllers when building cmake with tests enabled

  rafmudaf

  committed
  b18b924

• verify that the test data submodule was initialized before building the test

  rafmudaf

  committed
  ffbde48

• run cmake's ctest in the ctest-build directory for consistency with standalone ctest

  rafmudaf

  committed
  95843eb

• code and comment refactor

  rafmudaf

  committed
  255fe5c

• convert the executable path to CMAKE style for cross platform compatibility

  rafmudaf

  committed
  fcf10ad

• add README to ctest directory

  rafmudaf

  committed
  a76a5fc

Commits on May 17, 2017

• automatically determine archtecture type for input to ServoDyn controller compile script

  rafmudaf

  committed
  cc44d57

Commits on May 18, 2017

• add an input argument check for the test tolerance

  rafmudaf

  committed
  3e2bc3a

• propagate errors upstream for better error reporting, test the given executable before assuming it is executable

  rafmudaf

  committed
  c03f84d

• handle CYGWIN system name in CMake

  rafmudaf

  committed
  003a6b2

• print updates in the order they are generated; check for valid executable before attempting to run

  rafmudaf

  committed
  ca15ed5

Commits on May 19, 2017

• add a print statement for the pass-fail script command

  rafmudaf

  committed
  1fbc8bd

• use a norm rather than variance with an input tolerance to determine pass/fail

  rafmudaf

  committed
  75787d2

Commits on May 22, 2017

• update config file path to use CTest intrinsic variables rather than manually building the path

  rafmudaf

  committed
  66e9c67

• update the comments and README documentation with links, more clear language, and consistency between components

  rafmudaf

  committed
  587660b

• update comment

  rafmudaf

  committed
  044e4f7

• update README with new scheme determining pass/fail in the regression test

  rafmudaf

  committed
  a3eeb7d

Commits on May 23, 2017

• remove deprecated code

  rafmudaf

  committed
  1d85041

• update python scripts to Python 3 syntax

  rafmudaf

  committed
  5d892f7

• find the highest python interpreter available in CMake and use it for the reg test commands

  rafmudaf

  committed
  a78ad74

• update all python call signatures in documentation to python3; update listed python requirement to Python 3.0+

  rafmudaf

  committed
  85de90d

• update submodule to latest HEAD

  rafmudaf

  committed
  d44fdb1

• update the readthedocs test documentation to reflect an updated pass/fail scheme

  rafmudaf

  committed
  352bc47

• update the regression test readthedocs with more clear language

  rafmudaf

  committed
  ddd75cd

Commits on May 24, 2017

• configure reg_tests as a cmake subproject so it can be built independently of openfast

  rafmudaf

  committed
  fa79010

• update python program after changes to cmake driver; accept more explicit input arguments and build fewer directory paths internally

  rafmudaf

  committed
  a1a8abf

• update submodule to latest HEAD

  rafmudaf

  committed
  09f5368

• remove deprecated ctest standalone configuration files

  rafmudaf

  committed
  b8f221e

• remove deprecated python ctest driver

  rafmudaf

  committed
  adb6184

• add license summary to the top of source code

  rafmudaf

  committed
  e0a1619

• update the documentation after regression test rework

  rafmudaf

  committed
  5ad56fb