Skip to content

Latest commit

 

History

History
494 lines (253 loc) · 13.1 KB

HISTORY.rst

File metadata and controls

494 lines (253 loc) · 13.1 KB

Changelog

2.5.1

  • Python 3.12 compatibility improved

2.5.0

  • Add cli option to specify html report directory
  • Fix use patch file under Windows
  • Improve documentation about cache issues

2.4.5

  • Add skipped column in html index report
  • Untested/skipped in show all does not show skipped
  • mutmut should pick up the config before running the original tests. That allows to specify test suits you want to run
  • improved some high-level help text & documentation

2.4.4

  • Fix issue with TypeError for empty file diffs
  • Introduce mutation of f-strings
  • Allow newer versions of junit-xml

2.4.3

  • Fix for a big where worker cycling would just hang mutmut (thanks Jan Królikowski!)
  • Added --CI flag

2.4.2

  • Fix bug with init db on wrong function (thanks Samuel Razzell)
  • Fixed junitxml line number, daemon warning, and missing argument in unit test (thanks Samuel Razzell)

2.4.1

  • Support paths with path separators
  • Disable spinner in no-progress mode

2.4.0

  • Add pyproject support (thanks sed-i)

  • Change very small or very large numbers (floats) by a relative amount (thanks Peter Hill)

    This avoids (some) problems with unkillable mutants, for example:

    1e16 -> 1e+16

    which now becomes

    1e16 -> 2e+16

  • Fix inconsistent output of mutmut show after using --enable-mutation-types (thanks Andreas Finkler)

  • Improve test selection through pre_mutation(context) (thanks Andreas Finkler)

  • Remove --cache-only option and second argument to mutmut show (thanks Andreas Finkler)

2.3.0

  • Add --disable-mutation-types and --enable-mutation-types to control what types of mutations are performed
  • Fixed error where mutmut_config.init() was not called when running without explicitly having set PYTHONPATH
  • Use Click's subcommand feature to refactor the command line interface. For the end user, this can now run mutmut [COMMAND] -h to check which parameters are relevant to this specific subcommand. The change is backwards compatible, and all existing commands work the same as before, with the exception of mutmut --version, which now has to be mutmut version.
  • You can now set the context.config.test_command in the mutmut_config.pre_mutation(context) hook to select the relevant subset of tests. Coverage contexts are now accessible in config.coverage_data to help with the selection.

2.2.0

  • Add ability to update progress output only after test passes (--no-progress)
  • Added option --simple-output to disable usage of emojis in output
  • Fixed the total mutants and killed column in html report (#184)
  • Fixed paths_to_exclude config parsing
  • Stricter error code check for test runners. The previous check sometimes counted no tests as a killed mutant
  • Misc fixes

2.1.0

  • Support unittest, so you don't need pytest anymore
  • Fixed a bug where Ctrl+C wouldn't exit mutmut
  • Support for Coverage 5
  • Skip mutating test files if they are in the same source tree as the main code
  • Advanced whitelisting: More advanced AST level callback

2.0.0

  • New execution model. This should result in some modest speed improvements when using pytest.
  • A special execution mode when using the hammett test runner. This is MUCH MUCH faster. Please try it!
  • Dropped support for python < 3.7. If you need to use mutmut on older versions of python, please use mutmut 1.9.0
  • Some other speed improvements.

1.9.0

  • mutmut run 7 will always rerun the mutant 7
  • mutmut show <filename> to show all mutants for that file
  • mutmut run <filename> to run mutation testing on that file
  • New experimental plugin system: create a file mutmut_config.py in your base directory. In it you can have an init() function, and a pre_mutation(context) function. You can set context.skip = True to skip a mutant, and you can modify context.config.runner, this is useful to limit the tests. Check out the Context class for what information you get.
  • Better display of mutmut show/mutmut result
  • Fixed a spurious mutant on assigning a local variable with type annotations

1.8.1

  • mutmut now will rerun tests without mutation when tests have changed. This avoids a common pitfall of introducing a failing test and then having all mutants killed incorrectly

1.8.0 (2020-03-02)

  • Added mutmut html report generation.

1.7.0 (2020-02-29)

  • Bugfix for multiple assignment. Mutmut used to not handle foo = bar = baz correctly (Thanks Roxane Bellot!)
  • Bugfix for incorrect mutation of "in" operator (Thanks Roxane Bellot!)
  • Fixed bug where a mutant survived in the internal AST too long. This could cause mutmut to apply more than one mutant at a time.
  • Vastly improved startup performance when resuming a mutation run.
  • Added new experimental feature for advanced config at runtime of mutations

1.6.0 (2019-09-21)

  • Add mutmut show [path to file] command that shows all mutants for a given file
  • Better error messages if .coverage file isn't usable
  • Added support for windows paths in tests
  • Use the same python executable as mutmut is started as if possible
  • Dropped python 2 support
  • Added more assignment operator mutations
  • Bugfixes

1.5.0 (2019-04-10)

  • New mutation: None -> ''
  • Display all diffs for surviving mutants for a specific file with mutmut show all path/to/file.py
  • Display all diffs for surviving mutants with mutmut show all
  • Fixed a bug with grouping of the results for mutmut results
  • Fixed bug where mutmut show X sometimes showed no diff
  • Fixed bug where mutmut apply X sometimes didn't apply a mutation
  • Improved error message when trying to find the code
  • Fixed incorrect help message

1.4.0 (2019-03-26)

  • New setting: --test-time-base=15.0. This flag can be used to avoid issues with timing.
  • Post and pre hooks for the mutation step: --pre-mutation=command and --post-mutation=command if you want to run some command before and after a mutation testing round.
  • Fixed a bug with mutation of imports.
  • Fixed missing newline at end of the output of mutmut.
  • Support for mutating only lines specified by a patch file: --use-patch-file=foo.patch.
  • Fixed mutation of arguments in function call.
  • Looser heuristics for finding the source to mutate. This should mean more projects will just work out of the box.
  • Fixed mutation of arguments in function call for python 2.7.
  • Fixed a bug where if mutmut couldn't find the test code it thought the tests hadn't changed. Now mutmut treats this situation as the tests always being changed.
  • Fixed bug where the function body was skipped for mutation if a return type annotation existed.

1.3.1 (2019-01-30)

  • Fixed a bug where mutmut crashed if a file contained exactly zero bytes.

1.3.0 (2019-01-23)

  • Fixed incorrect loading of coverage data when using the --use-coverage flag.
  • Fixed a bug when updating the cache.
  • Fixed incorrect handling of source files that didn't end with a newline.

1.2.0 (2019-01-10)

  • JUnit XML output: Run mutmut junitxml to output the results as a JUnit compatible XML file.
  • Python 2 compatibility fixes.
  • pypy compatibility fixes.
  • Fixed an issue where mutmut couldn't kill the spawned test process.
  • Travis tests now test much more thoroughly, both python2, 3, pypy and on windows.
  • The return code of mutmut now reflects what mutmut found during execution.
  • New command line option --test-time-multiplier to tweak the detection threshold for mutations that make the code slower.
  • Fixed compatibility with Windows.

Thanks goes out Marcelo Da Cruz Pinto, Savo Kovačević,

1.1.0 (2018-12-10)

  • New mutant: mutate the first argument of function calls to None if it's not already None
  • Totally overhauled cache system: now handles duplicates lines correctly.

1.0.1 (2018-11-18)

  • Minor UX fixes: --version command was broken, incorrect documentation shown, missing newline at the very end.
  • Caching the baseline test time. This makes restarting/rechecking existing mutants much faster, with a small risk of that time being out of date.

1.0.0 (2018-11-12)

  • Totally new user interface! Should be much easier to understand and it's easier to see that something is happening
  • Totally new cache handling. Mutmut will now know which mutants are already killed and not try them again, and it will know which mutants to retest if the tests change
  • Infinite loop detection now works in Python < 3.3
  • Added --version flag
  • Nice error message when no .coverage file is found when using the --use-coverage flag
  • Fixed crash when using --use-coverage flag. Thanks Daniel Hahler!
  • Added mutation based on finding on tri.struct

0.0.24 (2018-11-04)

  • Stopped mutation of type annotation
  • Simple infinite loop detection: timeout on 10x the baseline time

0.0.23 (2018-11-03)

  • Make number_mutation more robust to floats (Thanks Trevin Gandhi!)
  • Fixed crash when using Python 3 typing to declare a type but not assigning to that variable

0.0.22 (2018-10-07)

  • Handle annotated assignment in Python 3.6. Thanks William Orr!

0.0.21 (2018-08-25)

  • Fixed critical bug: mutmut reported killed mutants as surviving and vice versa.
  • Fixed an issue where the install failed on some systems.
  • Handle tests dirs spread out in the file system. This is the normal case for django projects for example.
  • Fixes for supporting both python 3 and 2.
  • Misc mutation fixes.
  • Ability to test a single mutation.
  • Feature to print the cache (--print-cache).
  • Turned off error recovery mode for parso. You will now get exceptions for invalid or unsupported python code.

0.0.20 (2018-08-02)

  • Changed AST library from baron to parso
  • Some usability enhancements suggested by David M. Howcraft

0.0.19 (2018-07-20)

  • Caching of mutation testing results. This is still rather primitive but can in some cases cut down on rerunning mutmut drastically.
  • New mutation IDs. They are now indexed per line instead of an index for the entire file. This means you can apply your mutations in any order you see fit and the rest of the apply commands will be unaffected.

0.0.18 (2018-04-27)

  • Fixed bug where initial mutation count was wrong, which caused mutmut to miss mutants at the end of the file
  • Changed mutation API to always require a Context object. This makes is much easier to pass additional data out to the caller
  • Support specifying individual files to mutate (thanks Felipe Pontes!)

0.0.16 (2017-10-09)

  • Improve error message when baron crashes a bit (fixes #10)
  • New mutation: right hand side of assignments
  • Fixed nasty bug where applying a mutation could apply a different mutation than the one that was found during mutation testing

0.0.14 (2017-09-02)

  • Don't assume UNIX (fixes github issue #9: didn't work on windows)

0.0.12 (2017-08-27)

  • Changed default runner to add -x flag to pytest. Could radically speed up tests if you're lucky!
  • New flag: --show-times
  • Now warns if a mutation triggers very long test times
  • Added a workaround for pytest-testmon (all tests deselected is return code 5 even though it's a success)

0.0.11 (2017-08-03)

  • Fixed bug that made mutmut crash when setup.cfg was missing

0.0.10 (2017-07-16)

  • Renamed parameter --testsdir to --tests-dir
  • Refactored handling of setup.cfg file. Much cleaner solution and adds --dict-synonyms command line parameter

0.0.9 (2017-07-05)

  • Bug with dict param mutations: it mutated all parameters, this could vastly decrease the odds of finding a mutant
  • New mutation: remove the body or return 0 instead of None

0.0.8 (2017-06-28)

  • Previous version had broken version on pypi

0.0.7 (2017-06-28)

  • Fixed bug where pragma didn't work for decorator mutations
  • Dict literals looking like dict(a=foo) now have mutated keys. You can also declare synonyms in setup.cfg.
  • Fix "from x import *"

0.0.6 (2017-06-13)

  • New mutation: remove decorators!
  • Improved status while running. This should make it easier to handle when you hit mutants that cause infinite loops.
  • Fixes failing attempts to mutate parentheses. (Thanks Hristo Georgiev!)

0.0.5 (2017-05-06)

  • Try to fix pypi package

0.0.4 (2017-05-06)

  • Try to fix pypi package

0.0.3 (2017-05-05)

  • Python 3 support (as far as baron supports it anyway)
  • Try running without mutations first to make sure we can run the test suite cleanly before starting mutation
  • Implemented feature to run mutation on covered lines only, this is useful for mutation testing existing tests when you don't have 100% coverage
  • Error message on incorrect invocation

0.0.2 (2016-12-01)

  • Tons of fixes

0.0.1 (2016-12-01)

  • Initial version