release_notes.md

next (unreleased)

• #783 Use legacy results for iOS by default. (pawelpasterz)

v20.05.1

• #775 Fix exception thrown for null start time. (pawelpasterz)

v20.05.0

• #764 Fix crash on parse some control chars. (adamfilipow92)
• #772 Fail fast when results-dir is incorrect. (jan-gogo)
• #757 Reduce memory usage by using Reader and Writer instead of ByteArrays. (jan-gogo)
• #763 Use "localhost" as default for hostname to fix backward compatibility. (jan-gogo)
• #757 Print version and revision before each command. (jan-gogo)
• #759 Add shard name for uploaded xctestrun files. (pawelpasterz)
• #755 Remove ascii doc generated section header. (jan-gogo)
• #731 Refactor jUnit HTML report. (Writhe)
• #754 Sync README.md flank.yml flank.ios.yml. (jan-gogo)
• #746 Ignore apk with filtered out tests instead of failing. (pawelpasterz)
• #741 Allow APKs with zero tests. (fondesa)
• #737 Generate ascii doc. (jan-gogo)
• #720 Update group id from flank to com.github.flank (bootstraponline)
• #714 Add support for num-uniform-shards option. (jan-gogo)
• #712 Add keep file path for ios. (pawelpasterz)
• #711 Remove hardcoded height. (pawelpasterz)
• #708 Add ignore failed tests option to Flank. (pawelpasterz)
• #704 Add robo for robo-directives & robo-script options. (jan-gogo)
• #704 Fix shards calculation when there are ignored tests and shardTime is -1. (jan-gogo)
• #692 Add support for other-files option. (jan-gogo)
• #695 Add support for additional-apks option. (jan-gogo)
• #683 Print web link. (pawelpasterz)
• #692 Add support for network-profiles list command & --network-profile option. (jan-gogo)
• #689 Add support for client-details option. (jan-gogo)
• #687 Debug message printed after every command. (pawelpasterz)
• #684 Add overhead time to junit test case report. (jan-gogo)
• #666 Use API instead of XML for result parsing for android. (jan-gogo)
• #678 Skip Bugsnag initialization if user disabled gcloud analytics. (pawelpasterz)
• #672 Flank timeout feature. (pawelpasterz)
• #657 Fix execution hangs. (pawelpasterz)
• #654 Fix test filters when using both notPackage and notClass. (jan-gogo)
• #648 Include @Ignore JUnit tests in JUnit XML. (pawelpasterz)
• #646 Adopt kotlin-logging as a logging framework. (jan-gogo)
• #644 Use high performance options by default. Video, login, and perf metrics are now disabled by default. (pawelpasterz)
• #643 Add --dry option to android run & ios run. (jan-gogo)
• #642 Flank doctor should exit 1 on validation issues. (pawelpasterz)
• #641 Move all deps to Deps.kt (doodla)
• #640 Update gradle to 6.2.1 and JaCoCo to 0.8.5. (doodla)
• #639 Cache all uploads and downloads to GCS. (Kurt-Bonatz)
• #635 Default to 2m time estimate for unknown tests when sharding. (RainNapper)
• #621 Adopt server side sharding. Max shard count is 50. (bootstraponline)

v8.1.0

• #612 Print HtmlErrorReport location. (bootstraponline)
• #615 Add --keep-file-path for Android when downloading assets from Google Cloud Storage. (tahirhajizada)

v8.0.1

• #608 Use MatrixRollupOutcome to set exit code value. (bootstraponline)

v8.0.0

• #595 Rename flaky-test-attempts to num-flaky-test-attempts. Rename repeat-tests to num-test-runs. (bootstraponline)
• #605 Improve exit code logging. Use matrix outcome to set exit code. (bootstraponline)
• #597 Support parsing testLabExecutionId. (yogurtearl)
• #599 Disable FAIL_ON_UNKNOWN_PROPERTIES for forward compatibility. (narenkmanoharan)

v7.0.2

• #589 Fix java.lang.NumberFormatException: empty String. (vfadc)
• #587 Optimize polling. (bootstraponline)

v7.0.1

• #586 Poll devices in parallel. Fixes performance regression in Flank v7. (bootstraponline)

v7.0.0

• #574 Improve test shard error reporting. Update device catalog to use projectId. (bootstraponline)
• #582 Fix iOS exit code when using flaky-test-attempts. Don't print environment-variables to stdout for security. (bootstraponline)
• #584 Poll all test executions instead of only the first per matrix. (bootstraponline)
• #585 Fix bug in smart flank when sharding tests that run in 0 seconds. (bootstraponline)

v6.2.3

• #567 Fix --app & --test on Android CLI. (bootstraponline)
• #571 Add flank ios run --dump-shards and flank android run --dump-shards for debugging (bootstraponline)
• #572 Fix exit code reporting when using flaky-test-attempts (bootstraponline)

v6.2.2

• #566 Fix --test & --xctestrun-file on iOS CLI. (bootstraponline)

v6.2.1

• #563 Fix CLI support for iOS. (bootstraponline)

v6.2.0

• #560 Add --test-runner-class support for Android. (jschear)

v6.1.0

• #542 Add additional-app-test-apks to include multiple app/test apk pairs in a single run. (bootstraponline)

v6.0.1

• #550 Update dex-test-parser to fix Inherited crash. (bootstraponline)

v6.0.0

• #541 Rename --test-shards CLI flag to --max-test-shards. Add --smart-flank-gcs-path CLI flag. (bootstraponline)
• #544 Fix empty test targets crash. (bootstraponline)
• #548 Fix flank cancel. Print os name when sharding iOS tests. (bootstraponline)
• #549 Update to llvm 8.0.0 and Swift 5.0.1. (bootstraponline)

v5.1.0

• #537 Add smart-flank-disable-upload yml option to prevent new results from overriding previous results. (elihart)

v5.0.2

• #538 Update dextestparser. Fixes APK parsing crash. (bootstraponline)
• #536 Always calculate exit code from matrix status instead of JUnit XML. (bootstraponline)

v5.0.1

• #534 Fix updateMatrixFile not saving matrix_ids.json. (bootstraponline)

v5.0.0

• #506 Add bugsnag reporting to detect Flank crashes. (bootstraponline)
• #507 Improve error message when credentials fail to load, folder doesn't exist, and on bucket creation failure. Properly pass through user credential when checking the storage bucket. (bootstraponline)
• #514 Rename testShards to maxTestShards (miguelslemos)
• #518 Add deprecation warnings when old key names are used. flank android doctor --fix will auto fix the YAML file. (bootstraponline)
• #519 Rename maxTestShards to max-test-shards, shardTime to shard-time, repeatTests to repeat-tests, smartFlankGcsPath to smart-flank-gcs-path, disableSharding to disable-sharding. Moved project from gcloud to flank (bootstraponline)
• #523 Add --local-result-dir to make it easy to find the test result at a fixed path. (bootstraponline)
• #524 Fix iOS test sharding when there's a space in the path (bootstraponline)
• #522 Correctly report test results and exit code when using flaky-test-attempts (bootstraponline)
• #530 Save files downloaded with files-to-download to device root folder. Fix web links in HTML report. (bootstraponline)
• #533 Update matrix_ids.json on every matrix change. Useful for debugging runs that crashed. (jschear)

v4.4.0

• #505 Fix flank auth login by using google-auth-library-java. (bootstraponline)
• #501 Fix nullability check in SavedMatrix. (bootstraponline)
• #493 Fix getDefaultBucket timeout. (bootstraponline)

v4.3.1

• #491 Fix shardTime when testShards is -1 (Macarse)

v4.3.0

• #436 Print how accurate test times are when using smart flank (Macarse)
• #462 Always find all iOS tests when sharding. (bootstraponline)
• #471 Add dynamic bucket counts for Smart Flank via shardTime (Macarse)
• #473 Add disableSharding flag (Macarse)
• #476 Retry matrix creation when FTL API errors. (bootstraponline)
• #477 Fix large number merging on iOS (bootstraponline)
• #478 Add iOS regular expression filtering for test-targets (Macarse)
• #479 Improve invalid iOS regex error message (bootstraponline)
• #481 Add iOS support for locale and orientation (Macarse)
• #482 Document Android code coverage with orchestrator on FTL (bootstraponline)
• #485 Replace : in folder name to improve Windows support. (Sunil-plsr)
• #487 Document all Flank YAML properties in README (bootstraponline)

v4.2.0

• Fix create Gcs bucket #444
• Add files-to-download to Android and iOS. Specify a list of regular expressions to download files from the Google Cloud Storage bucket. #441
• Add flank auth login to authorize with a user account instead of a service account. #446
• Add flaky-test-attempts support on Android and iOS which automatically retries failed tests. #454

v4.1.1

• Add support for parameterized iOS tests when shard count is 1. #435
• Add support for SkipTestIdentifiers when parsing iOS .xctestrun files. #435

v4.1.0

• app, test, and xctestrun-file now support ~, environment variables, and globs (*, **) when resolving paths. #386
• Add CLI support for flank android run and flank ios run
• Add experimental smartFlankGcsPath to shard iOS and Android tests by time using historical run data. The amount of shards used is set by testShards. #385
• Fix parsing empty testcase #402
• Add progress bar when uploading files. #403
• iOS iPhone 8 default device has been updated from 11.2 to 12.0.

v4.0.0

• Add flank cancel command. See flank cancel --help
• Add flank refresh command. See flank refresh --help
• Automatically detect projectId from service account credential
• Always generate aggregated JUnit XML reports
• Update HTML report to use create-react-app v2.1.0
• Add support for Xcode 10.1
• Improve test parsing to detect Swift tests that throw errors
• Update Flank exit codes, see readme for details.
• Link to matrix root when testing on multiple devices