Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update pytest to 3.3.0 #21

Closed
wants to merge 1 commit into from
Closed

Update pytest to 3.3.0 #21

wants to merge 1 commit into from

Conversation

pyup-bot
Copy link
Collaborator

There's a new version of pytest available.
You are currently using 2.9.2. I have updated it to 3.3.0

These links might come in handy: PyPI | Changelog | Repo | Homepage

Changelog

3.3.0

=========================

Deprecations and Removals

  • Pytest no longer supports Python 2.6 and 3.3. Those Python versions
    are EOL for some time now and incur maintenance and compatibility costs on
    the pytest core team, and following up with the rest of the community we
    decided that they will no longer be supported starting on this version. Users
    which still require those versions should pin pytest to <3.3. (2812 <https://github.com/pytest-dev/pytest/issues/2812>_)
  • Remove internal _preloadplugins() function. This removal is part of the
    pytest_namespace() hook deprecation. (2236 <https://github.com/pytest-dev/pytest/issues/2236>_)
  • Internally change CallSpec2 to have a list of marks instead of a broken
    mapping of keywords. This removes the keywords attribute of the internal
    CallSpec2 class. (2672 <https://github.com/pytest-dev/pytest/issues/2672>_)
  • Remove ParameterSet.deprecated_arg_dict - its not a public api and the lack
    of the underscore was a naming error. (2675 <https://github.com/pytest-dev/pytest/issues/2675>_)
  • Remove the internal multi-typed attribute Node._evalskip and replace it
    with the boolean Node._skipped_by_mark. (2767 <https://github.com/pytest-dev/pytest/issues/2767>_)

Features

  • pytest_fixture_post_finalizer hook can now receive a request
    argument. (2124 <https://github.com/pytest-dev/pytest/issues/2124>_)
  • Replace the old introspection code in compat.py that determines the available
    arguments of fixtures with inspect.signature on Python 3 and
    funcsigs.signature on Python 2. This should respect __signature__
    declarations on functions. (2267 <https://github.com/pytest-dev/pytest/issues/2267>_)
  • Report tests with global pytestmark variable only once. (2549 <https://github.com/pytest-dev/pytest/issues/2549>_)
  • Now pytest displays the total progress percentage while running tests. The
    previous output style can be set by configuring the console_output_style
    setting to classic. (2657 <https://github.com/pytest-dev/pytest/issues/2657>_)
  • Match warns signature to raises by adding match keyword. (2708 <https://github.com/pytest-dev/pytest/issues/2708>_)
  • Pytest now captures and displays output from the standard logging module.
    The user can control the logging level to be captured by specifying options
    in pytest.ini, the command line and also during individual tests using
    markers. Also, a caplog fixture is available that enables users to test
    the captured log during specific tests (similar to capsys for example).
    For more information, please see the logging docs <https://docs.pytest.org/en/latest/logging.html>. This feature was
    introduced by merging the popular pytest-catchlog <https://pypi.org/project/pytest-catchlog/>     plugin, thanks to Thomas Hisch <https://github.com/thisch>. Be advised that during the merging the
    backward compatibility interface with the defunct pytest-capturelog has
    been dropped. (2794 <https://github.com/pytest-dev/pytest/issues/2794>    )
  • Add allow_module_level kwarg to pytest.skip(), enabling to skip the
    whole module. (2808 <https://github.com/pytest-dev/pytest/issues/2808>_)
  • Allow setting file_or_dir, -c, and -o in PYTEST_ADDOPTS. (2824 <https://github.com/pytest-dev/pytest/issues/2824>_)
  • Return stdout/stderr capture results as a namedtuple, so out and
    err can be accessed by attribute. (2879 <https://github.com/pytest-dev/pytest/issues/2879>_)
  • Add capfdbinary, a version of capfd which returns bytes from
    readouterr(). (2923 <https://github.com/pytest-dev/pytest/issues/2923>_)
  • Add capsysbinary a version of capsys which returns bytes from
    readouterr(). (2934 <https://github.com/pytest-dev/pytest/issues/2934>_)
  • Implement feature to skip setup.py files when run with
    --doctest-modules. (502 <https://github.com/pytest-dev/pytest/issues/502>_)

Bug Fixes

  • Resume output capturing after capsys/capfd.disabled() context manager.
    (1993 <https://github.com/pytest-dev/pytest/issues/1993>_)
  • pytest_fixture_setup and pytest_fixture_post_finalizer hooks are now
    called for all conftest.py files. (2124 <https://github.com/pytest-dev/pytest/issues/2124>_)
  • If an exception happens while loading a plugin, pytest no longer hides the
    original traceback. In python2 it will show the original traceback with a new
    message that explains in which plugin. In python3 it will show 2 canonized
    exceptions, the original exception while loading the plugin in addition to an
    exception that PyTest throws about loading a plugin. (2491 <https://github.com/pytest-dev/pytest/issues/2491>_)
  • capsys and capfd can now be used by other fixtures. (2709 <https://github.com/pytest-dev/pytest/issues/2709>_)
  • Internal pytester plugin properly encodes bytes arguments to
    utf-8. (2738 <https://github.com/pytest-dev/pytest/issues/2738>_)
  • testdir now uses use the same method used by tmpdir to create its
    temporary directory. This changes the final structure of the testdir
    directory slightly, but should not affect usage in normal scenarios and
    avoids a number of potential problems. (2751 <https://github.com/pytest-dev/pytest/issues/2751>_)
  • Pytest no longer complains about warnings with unicode messages being
    non-ascii compatible even for ascii-compatible messages. As a result of this,
    warnings with unicode messages are converted first to an ascii representation
    for safety. (2809 <https://github.com/pytest-dev/pytest/issues/2809>_)
  • Change return value of pytest command when --maxfail is reached from
    2 (interrupted) to 1 (failed). (2845 <https://github.com/pytest-dev/pytest/issues/2845>_)
  • Fix issue in assertion rewriting which could lead it to rewrite modules which
    should not be rewritten. (2939 <https://github.com/pytest-dev/pytest/issues/2939>_)
  • Handle marks without description in pytest.ini. (2942 <https://github.com/pytest-dev/pytest/issues/2942>_)

Trivial/Internal Changes

  • pytest now depends on attrs <https://pypi.org/project/attrs/>_ for internal
    structures to ease code maintainability. (2641 <https://github.com/pytest-dev/pytest/issues/2641>_)
  • Refactored internal Python 2/3 compatibility code to use six. (2642 <https://github.com/pytest-dev/pytest/issues/2642>_)
  • Stop vendoring pluggy - we're missing out on its latest changes for not
    much benefit (2719 <https://github.com/pytest-dev/pytest/issues/2719>_)
  • Internal refactor: simplify ascii string escaping by using the
    backslashreplace error handler in newer Python 3 versions. (2734 <https://github.com/pytest-dev/pytest/issues/2734>_)
  • Remove unnecessary mark evaluator in unittest plugin (2767 <https://github.com/pytest-dev/pytest/issues/2767>_)
  • Calls to Metafunc.addcall now emit a deprecation warning. This function
    is scheduled to be removed in pytest-4.0. (2876 <https://github.com/pytest-dev/pytest/issues/2876>_)
  • Internal move of the parameterset extraction to a more maintainable place.
    (2877 <https://github.com/pytest-dev/pytest/issues/2877>_)
  • Internal refactoring to simplify scope node lookup. (2910 <https://github.com/pytest-dev/pytest/issues/2910>_)
  • Configure pytest to prevent pip from installing pytest in unsupported
    Python versions. (2922 <https://github.com/pytest-dev/pytest/issues/2922>_)

3.2.5

=========================

Bug Fixes

  • Remove py<1.5 restriction from pytest as this can cause version
    conflicts in some installations. (2926 <https://github.com/pytest-dev/pytest/issues/2926>_)

3.2.4

=========================

Bug Fixes

  • Fix the bug where running with --pyargs will result in items with
    empty parent.nodeid if run from a different root directory. (2775 <https://github.com/pytest-dev/pytest/issues/2775>_)
  • Fix issue with pytest.parametrize if argnames was specified as keyword arguments.
    (2819 <https://github.com/pytest-dev/pytest/issues/2819>_)
  • Strip whitespace from marker names when reading them from INI config. (2856 <https://github.com/pytest-dev/pytest/issues/2856>_)
  • Show full context of doctest source in the pytest output, if the line number of
    failed example in the docstring is < 9. (2882 &lt;https://github.com/pytest-dev/pytest/issues/2882&gt;_)
  • Match fixture paths against actual path segments in order to avoid matching folders which share a prefix.
    (2836 &lt;https://github.com/pytest-dev/pytest/issues/2836&gt;_)

Improved Documentation

  • Introduce a dedicated section about conftest.py. (1505 &lt;https://github.com/pytest-dev/pytest/issues/1505&gt;_)
  • Explicitly mention xpass in the documentation of xfail. (1997 &lt;https://github.com/pytest-dev/pytest/issues/1997&gt;_)
  • Append example for pytest.param in the example/parametrize document. (2658 &lt;https://github.com/pytest-dev/pytest/issues/2658&gt;_)
  • Clarify language of proposal for fixtures parameters (2893 &lt;https://github.com/pytest-dev/pytest/issues/2893&gt;_)
  • List python 3.6 in the documented supported versions in the getting started
    document. (2903 &lt;https://github.com/pytest-dev/pytest/issues/2903&gt;_)
  • Clarify the documentation of available fixture scopes. (538 &lt;https://github.com/pytest-dev/pytest/issues/538&gt;_)
  • Add documentation about the python -m pytest invocation adding the
    current directory to sys.path. (911 &lt;https://github.com/pytest-dev/pytest/issues/911&gt;_)

3.2.3

=========================

Bug Fixes

  • Fix crash in tab completion when no prefix is given. (2748 &lt;https://github.com/pytest-dev/pytest/issues/2748&gt;_)
  • The equality checking function (__eq__) of MarkDecorator returns
    False if one object is not an instance of MarkDecorator. (2758 &lt;https://github.com/pytest-dev/pytest/issues/2758&gt;_)
  • When running pytest --fixtures-per-test: don't crash if an item has no
    fixtureinfo attribute (e.g. doctests) (2788 &lt;https://github.com/pytest-dev/pytest/issues/2788&gt;)

Improved Documentation

  • In help text of -k option, add example of using not to not select
    certain tests whose names match the provided expression. (1442 &lt;https://github.com/pytest-dev/pytest/issues/1442&gt;_)
  • Add note in parametrize.rst about calling metafunc.parametrize
    multiple times. (1548 &lt;https://github.com/pytest-dev/pytest/issues/1548&gt;_)

Trivial/Internal Changes

  • Set xfail_strict=True in pytest's own test suite to catch expected
    failures as soon as they start to pass. (2722 &lt;https://github.com/pytest-dev/pytest/issues/2722&gt;_)
  • Fix typo in example of passing a callable to markers (in example/markers.rst)
    (2765 &lt;https://github.com/pytest-dev/pytest/issues/2765&gt;_)

3.2.2

=========================

Bug Fixes

  • Calling the deprecated request.getfuncargvalue() now shows the source of
    the call. (2681 &lt;https://github.com/pytest-dev/pytest/issues/2681&gt;_)
  • Allow tests declared as staticmethod to use fixtures. (2699 &lt;https://github.com/pytest-dev/pytest/issues/2699&gt;_)
  • Fixed edge-case during collection: attributes which raised pytest.fail
    when accessed would abort the entire collection. (2707 &lt;https://github.com/pytest-dev/pytest/issues/2707&gt;_)
  • Fix ReprFuncArgs with mixed unicode and UTF-8 args. (2731 &lt;https://github.com/pytest-dev/pytest/issues/2731&gt;_)

Improved Documentation

  • In examples on working with custom markers, add examples demonstrating the
    usage of pytest.mark.MARKER_NAME.with_args in comparison with
    pytest.mark.MARKER_NAME.__call__ (2604 &lt;https://github.com/pytest-dev/pytest/issues/2604&gt;_)
  • In one of the simple examples, use pytest_collection_modifyitems() to skip
    tests based on a command-line option, allowing its sharing while preventing a
    user error when acessing pytest.config before the argument parsing. (2653 &lt;https://github.com/pytest-dev/pytest/issues/2653&gt;_)

Trivial/Internal Changes

  • Fixed minor error in 'Good Practices/Manual Integration' code snippet.
    (2691 &lt;https://github.com/pytest-dev/pytest/issues/2691&gt;_)
  • Fixed typo in goodpractices.rst. (2721 &lt;https://github.com/pytest-dev/pytest/issues/2721&gt;_)
  • Improve user guidance regarding --resultlog deprecation. (2739 &lt;https://github.com/pytest-dev/pytest/issues/2739&gt;_)

3.2.1

=========================

Bug Fixes

  • Fixed small terminal glitch when collecting a single test item. (2579 &lt;https://github.com/pytest-dev/pytest/issues/2579&gt;_)
  • Correctly consider / as the file separator to automatically mark plugin
    files for rewrite on Windows. (2591 &lt;https://github.com/pytest- dev/pytest/issues/2591&gt;_)
  • Properly escape test names when setting PYTEST_CURRENT_TEST environment
    variable. (2644 &lt;https://github.com/pytest-dev/pytest/issues/2644&gt;_)
  • Fix error on Windows and Python 3.6+ when sys.stdout has been replaced
    with a stream-like object which does not implement the full io module
    buffer protocol. In particular this affects pytest-xdist users on the
    aforementioned platform. (2666 &lt;https://github.com/pytest- dev/pytest/issues/2666&gt;_)

Improved Documentation

  • Explicitly document which pytest features work with unittest. (2626 &lt;https://github.com/pytest-dev/pytest/issues/2626&gt;_)

3.2.0

=========================

Deprecations and Removals

  • pytest.approx no longer supports &gt;, &gt;=, &lt; and &lt;=
    operators to avoid surprising/inconsistent behavior. See the approx docs &lt;https://docs.pytest.org/en/latest/builtin.htmlpytest.approx&gt;_ for more
    information. (2003 &lt;https://github.com/pytest-dev/pytest/issues/2003&gt;_)
  • All old-style specific behavior in current classes in the pytest's API is
    considered deprecated at this point and will be removed in a future release.
    This affects Python 2 users only and in rare situations. (2147 &lt;https://github.com/pytest-dev/pytest/issues/2147&gt;_)
  • A deprecation warning is now raised when using marks for parameters
    in pytest.mark.parametrize. Use pytest.param to apply marks to
    parameters instead. (2427 &lt;https://github.com/pytest-dev/pytest/issues/2427&gt;_)

Features

  • Add support for numpy arrays (and dicts) to approx. (1994 &lt;https://github.com/pytest-dev/pytest/issues/1994&gt;_)
  • Now test function objects have a pytestmark attribute containing a list
    of marks applied directly to the test function, as opposed to marks inherited
    from parent classes or modules. (2516 &lt;https://github.com/pytest- dev/pytest/issues/2516&gt;_)
  • Collection ignores local virtualenvs by default; --collect-in-virtualenv
    overrides this behavior. (2518 &lt;https://github.com/pytest- dev/pytest/issues/2518&gt;_)
  • Allow class methods decorated as staticmethod to be candidates for
    collection as a test function. (Only for Python 2.7 and above. Python 2.6
    will still ignore static methods.) (2528 &lt;https://github.com/pytest- dev/pytest/issues/2528&gt;_)
  • Introduce mark.with_args in order to allow passing functions/classes as
    sole argument to marks. (2540 &lt;https://github.com/pytest- dev/pytest/issues/2540&gt;_)
  • New cache_dir ini option: sets the directory where the contents of the
    cache plugin are stored. Directory may be relative or absolute path: if relative path, then
    directory is created relative to rootdir, otherwise it is used as is.
    Additionally path may contain environment variables which are expanded during
    runtime. (2543 &lt;https://github.com/pytest-dev/pytest/issues/2543&gt;_)
  • Introduce the PYTEST_CURRENT_TEST environment variable that is set with
    the nodeid and stage (setup, call and teardown) of the test
    being currently executed. See the documentation &lt;https://docs.pytest.org/en/latest/example/simple.htmlpytest-current-test- environment-variable&gt;_ for more info. (2583 &lt;https://github.com/pytest- dev/pytest/issues/2583&gt;_)
  • Introduced pytest.mark.filterwarnings mark which allows overwriting the
    warnings filter on a per test, class or module level. See the docs &lt;https://docs.pytest.org/en/latest/warnings.htmlpytest-mark- filterwarnings&gt;_ for more information. (2598 &lt;https://github.com/pytest- dev/pytest/issues/2598&gt;_)
  • --last-failed now remembers forever when a test has failed and only
    forgets it if it passes again. This makes it easy to fix a test suite by
    selectively running files and fixing tests incrementally. (2621 &lt;https://github.com/pytest-dev/pytest/issues/2621&gt;_)
  • New pytest_report_collectionfinish hook which allows plugins to add
    messages to the terminal reporting after collection has been finished
    successfully. (2622 &lt;https://github.com/pytest-dev/pytest/issues/2622&gt;_)
  • Added support for PEP-415&#39;s &lt;https://www.python.org/dev/peps/pep-0415/&gt;_
    Exception.__suppress_context__. Now if a raise exception from None is
    caught by pytest, pytest will no longer chain the context in the test report.
    The behavior now matches Python's traceback behavior. (2631 &lt;https://github.com/pytest-dev/pytest/issues/2631&gt;_)
  • Exceptions raised by pytest.fail, pytest.skip and pytest.xfail
    now subclass BaseException, making them harder to be caught unintentionally
    by normal code. (580 &lt;https://github.com/pytest-dev/pytest/issues/580&gt;_)

Bug Fixes

  • Set stdin to a closed PIPE in pytester.py.Testdir.popen() for
    avoid unwanted interactive pdb (2023 &lt;https://github.com/pytest- dev/pytest/issues/2023&gt;_)
  • Add missing encoding attribute to sys.std* streams when using
    capsys capture mode. (2375 &lt;https://github.com/pytest- dev/pytest/issues/2375&gt;_)
  • Fix terminal color changing to black on Windows if colorama is imported
    in a conftest.py file. (2510 &lt;https://github.com/pytest- dev/pytest/issues/2510&gt;_)
  • Fix line number when reporting summary of skipped tests. (2548 &lt;https://github.com/pytest-dev/pytest/issues/2548&gt;_)
  • capture: ensure that EncodedFile.name is a string. (2555 &lt;https://github.com/pytest-dev/pytest/issues/2555&gt;_)
  • The options --fixtures and --fixtures-per-test will now keep
    indentation within docstrings. (2574 &lt;https://github.com/pytest- dev/pytest/issues/2574&gt;_)
  • doctests line numbers are now reported correctly, fixing pytest-sugar122 &lt;https://github.com/Frozenball/pytest-sugar/issues/122&gt;. (2610 &lt;https://github.com/pytest-dev/pytest/issues/2610&gt;)
  • Fix non-determinism in order of fixture collection. Adds new dependency
    (ordereddict) for Python 2.6. (920 &lt;https://github.com/pytest- dev/pytest/issues/920&gt;_)

Improved Documentation

  • Clarify pytest_configure hook call order. (2539 &lt;https://github.com/pytest-dev/pytest/issues/2539&gt;_)
  • Extend documentation for testing plugin code with the pytester plugin.
    (971 &lt;https://github.com/pytest-dev/pytest/issues/971&gt;_)

Trivial/Internal Changes

  • Update help message for --strict to make it clear it only deals with
    unregistered markers, not warnings. (2444 &lt;https://github.com/pytest- dev/pytest/issues/2444&gt;_)
  • Internal code move: move code for pytest.approx/pytest.raises to own files in
    order to cut down the size of python.py (2489 &lt;https://github.com/pytest- dev/pytest/issues/2489&gt;_)
  • Renamed the utility function _pytest.compat._escape_strings to
    _ascii_escaped to better communicate the function's purpose. (2533 &lt;https://github.com/pytest-dev/pytest/issues/2533&gt;_)
  • Improve error message for CollectError with skip/skipif. (2546 &lt;https://github.com/pytest-dev/pytest/issues/2546&gt;_)
  • Emit warning about yield tests being deprecated only once per generator.
    (2562 &lt;https://github.com/pytest-dev/pytest/issues/2562&gt;_)
  • Ensure final collected line doesn't include artifacts of previous write.
    (2571 &lt;https://github.com/pytest-dev/pytest/issues/2571&gt;_)
  • Fixed all flake8 errors and warnings. (2581 &lt;https://github.com/pytest- dev/pytest/issues/2581&gt;_)
  • Added fix-lint tox environment to run automatic pep8 fixes on the code.
    (2582 &lt;https://github.com/pytest-dev/pytest/issues/2582&gt;_)
  • Turn warnings into errors in pytest's own test suite in order to catch
    regressions due to deprecations more promptly. (2588 &lt;https://github.com/pytest-dev/pytest/issues/2588&gt;_)
  • Show multiple issue links in CHANGELOG entries. (2620 &lt;https://github.com/pytest-dev/pytest/issues/2620&gt;_)

3.1.3

=========================

Bug Fixes

  • Fix decode error in Python 2 for doctests in docstrings. (2434 &lt;https://github.com/pytest-dev/pytest/issues/2434&gt;_)
  • Exceptions raised during teardown by finalizers are now suppressed until all
    finalizers are called, with the initial exception reraised. (2440 &lt;https://github.com/pytest-dev/pytest/issues/2440&gt;_)
  • Fix incorrect "collected items" report when specifying tests on the command-
    line. (2464 &lt;https://github.com/pytest-dev/pytest/issues/2464&gt;_)
  • deprecated_call in context-manager form now captures deprecation warnings
    even if the same warning has already been raised. Also, deprecated_call
    will always produce the same error message (previously it would produce
    different messages in context-manager vs. function-call mode). (2469 &lt;https://github.com/pytest-dev/pytest/issues/2469&gt;_)
  • Fix issue where paths collected by pytest could have triple leading /
    characters. (2475 &lt;https://github.com/pytest-dev/pytest/issues/2475&gt;_)
  • Fix internal error when trying to detect the start of a recursive traceback.
    (2486 &lt;https://github.com/pytest-dev/pytest/issues/2486&gt;_)

Improved Documentation

  • Explicitly state for which hooks the calls stop after the first non-None
    result. (2493 &lt;https://github.com/pytest-dev/pytest/issues/2493&gt;_)

Trivial/Internal Changes

  • Create invoke tasks for updating the vendored packages. (2474 &lt;https://github.com/pytest-dev/pytest/issues/2474&gt;_)
  • Update copyright dates in LICENSE, README.rst and in the documentation.
    (2499 &lt;https://github.com/pytest-dev/pytest/issues/2499&gt;_)

3.1.2

=========================

Bug Fixes

  • Required options added via pytest_addoption will no longer prevent using
    --help without passing them. (1999)
  • Respect python_files in assertion rewriting. (2121)
  • Fix recursion error detection when frames in the traceback contain objects
    that can't be compared (like numpy arrays). (2459)
  • UnicodeWarning is issued from the internal pytest warnings plugin only
    when the message contains non-ascii unicode (Python 2 only). (2463)
  • Added a workaround for Python 3.6 WindowsConsoleIO breaking due to Pytests's
    FDCapture. Other code using console handles might still be affected by the
    very same issue and might require further workarounds/fixes, i.e. colorama.
    (2467)

Improved Documentation

  • Fix internal API links to pluggy objects. (2331)
  • Make it clear that pytest.xfail stops test execution at the calling point
    and improve overall flow of the skipping docs. (810)

3.1.1

=========================

Bug Fixes

  • pytest warning capture no longer overrides existing warning filters. The
    previous behaviour would override all filters and caused regressions in test
    suites which configure warning filters to match their needs. Note that as a
    side-effect of this is that DeprecationWarning and
    PendingDeprecationWarning are no longer shown by default. (2430)
  • Fix issue with non-ascii contents in doctest text files. (2434)
  • Fix encoding errors for unicode warnings in Python 2. (2436)
  • pytest.deprecated_call now captures PendingDeprecationWarning in
    context manager form. (2441)

Improved Documentation

  • Addition of towncrier for changelog management. (2390)

3.1.0

==================

New Features

  • The pytest-warnings plugin has been integrated into the core and now pytest automatically
    captures and displays warnings at the end of the test session.

.. warning::

This feature may disrupt test suites which apply and treat warnings themselves, and can be
disabled in your pytest.ini:

.. code-block:: ini

 [pytest]
 addopts = -p no:warnings

See the warnings documentation page &lt;https://docs.pytest.org/en/latest/warnings.html&gt;_ for more
information.

Thanks nicoddemus_ for the PR.

  • Added junit_suite_name ini option to specify root &lt;testsuite&gt; name for JUnit XML reports (533_).
  • Added an ini option doctest_encoding to specify which encoding to use for doctest files.
    Thanks wheerd_ for the PR (2101_).
  • pytest.warns now checks for subclass relationship rather than
    class equality. Thanks lesteve_ for the PR (2166_)
  • pytest.raises now asserts that the error message matches a text or regex
    with the match keyword argument. Thanks Kriechi_ for the PR.
  • pytest.param can be used to declare test parameter sets with marks and test ids.
    Thanks RonnyPfannschmidt_ for the PR.

Changes

  • remove all internal uses of pytest_namespace hooks,
    this is to prepare the removal of preloadconfig in pytest 4.0
    Thanks to RonnyPfannschmidt_ for the PR.
  • pytest now warns when a callable ids raises in a parametrized test. Thanks fogo_ for the PR.
  • It is now possible to skip test classes from being collected by setting a
    __test__ attribute to False in the class body (2007). Thanks
    to syre     for the report and lwm_ for the PR.
  • Change junitxml.py to produce reports that comply with Junitxml schema.
    If the same test fails with failure in call and then errors in teardown
    we split testcase element into two, one containing the error and the other
    the failure. (2228) Thanks to kkoukiou for the PR.
  • Testcase reports with a url attribute will now properly write this to junitxml.
    Thanks fushi_ for the PR (1874_).
  • Remove common items from dict comparision output when verbosity=1. Also update
    the truncation message to make it clearer that pytest truncates all
    assertion messages if verbosity < 2 (1512).
    Thanks mattduck     for the PR
  • --pdbcls no longer implies --pdb. This makes it possible to use
    addopts=--pdbcls=module.SomeClass on pytest.ini. Thanks davidszotten_ for
    the PR (1952_).
  • fix 2013_: turn RecordedWarning into namedtuple,
    to give it a comprehensible repr while preventing unwarranted modification.
  • fix 2208_: ensure a iteration limit for pytest.compat.get_real_func.
    Thanks RonnyPfannschmidt     for the report and PR.
  • Hooks are now verified after collection is complete, rather than right after loading installed plugins. This
    makes it easy to write hooks for plugins which will be loaded during collection, for example using the
    pytest_plugins special variable (1821).
    Thanks nicoddemus     for the PR.
  • Modify pytest_make_parametrize_id() hook to accept argname as an
    additional parameter.
    Thanks unsignedint_ for the PR.
  • Add venv to the default norecursedirs setting.
    Thanks The-Compiler_ for the PR.
  • PluginManager.import_plugin now accepts unicode plugin names in Python 2.
    Thanks reutsharabani_ for the PR.
  • fix 2308: When using both --lf and --ff, only the last failed tests are run.
    Thanks ojii     for the PR.
  • Replace minor/patch level version numbers in the documentation with placeholders.
    This significantly reduces change-noise as different contributors regnerate
    the documentation on different platforms.
    Thanks RonnyPfannschmidt_ for the PR.
  • fix 2391: consider pytest_plugins on all plugin modules
    Thanks RonnyPfannschmidt     for the PR.

Bug Fixes

  • Fix AttributeError on sys.stdout.buffer / sys.stderr.buffer
    while using capsys fixture in python 3. (1407).
    Thanks to asottile    .
  • Change capture.py's DontReadFromInput class to throw io.UnsupportedOperation errors rather
    than ValueErrors in the fileno method (2276).
    Thanks metasyn     and vlad-dragos_ for the PR.
  • Fix exception formatting while importing modules when the exception message
    contains non-ascii characters (2336).
    Thanks fabioz     for the report and nicoddemus_ for the PR.
  • Added documentation related to issue (1937)
    Thanks skylarjhdownes     for the PR.
  • Allow collecting files with any file extension as Python modules (2369).
    Thanks Kodiologist     for the PR.
  • Show the correct error message when collect "parametrize" func with wrong args (2383).
    Thanks The-Compiler     for the report and robin0371_ for the PR.

.. _davidszotten: https://github.com/davidszotten
.. _fabioz: https://github.com/fabioz
.. _fogo: https://github.com/fogo
.. _fushi: https://github.com/fushi
.. _Kodiologist: https://github.com/Kodiologist
.. _Kriechi: https://github.com/Kriechi
.. _mandeep: https://github.com/mandeep
.. _mattduck: https://github.com/mattduck
.. _metasyn: https://github.com/metasyn
.. _MichalTHEDUDE: https://github.com/MichalTHEDUDE
.. _ojii: https://github.com/ojii
.. _reutsharabani: https://github.com/reutsharabani
.. _robin0371: https://github.com/robin0371
.. _skylarjhdownes: https://github.com/skylarjhdownes
.. _unsignedint: https://github.com/unsignedint
.. _wheerd: https://github.com/wheerd

.. _1407: pytest-dev/pytest#1407
.. _1512: pytest-dev/pytest#1512
.. _1821: pytest-dev/pytest#1821
.. _1874: pytest-dev/pytest#1874
.. _1937: pytest-dev/pytest#1937
.. _1952: pytest-dev/pytest#1952
.. _2007: pytest-dev/pytest#2007
.. _2013: pytest-dev/pytest#2013
.. _2101: pytest-dev/pytest#2101
.. _2166: pytest-dev/pytest#2166
.. _2208: pytest-dev/pytest#2208
.. _2228: pytest-dev/pytest#2228
.. _2276: pytest-dev/pytest#2276
.. _2308: pytest-dev/pytest#2308
.. _2336: pytest-dev/pytest#2336
.. _2369: pytest-dev/pytest#2369
.. _2383: pytest-dev/pytest#2383
.. _2391: pytest-dev/pytest#2391
.. _533: pytest-dev/pytest#533

3.0.7

==================

  • Fix issue in assertion rewriting breaking due to modules silently discarding
    other modules when importing fails
    Notably, importing the anydbm module is fixed. (2248).
    Thanks pfhayes     for the PR.
  • junitxml: Fix problematic case where system-out tag occured twice per testcase
    element in the XML report. Thanks kkoukiou_ for the PR.
  • Fix regression, pytest now skips unittest correctly if run with --pdb
    (2137). Thanks to gst for the report and mbyt_ for the PR.
  • Ignore exceptions raised from descriptors (e.g. properties) during Python test collection (2234).
    Thanks to bluetech    .
  • --override-ini now correctly overrides some fundamental options like python_files (2238).
    Thanks sirex     for the report and nicoddemus_ for the PR.
  • Replace raise StopIteration usages in the code by simple returns to finish generators, in accordance to PEP-479_ (2160).
    Thanks tgoodlet     for the report and nicoddemus_ for the PR.
  • Fix internal errors when an unprintable AssertionError is raised inside a test.
    Thanks omerhadari_ for the PR.
  • Skipping plugin now also works with test items generated by custom collectors (2231).
    Thanks to vidartf    .
  • Fix trailing whitespace in console output if no .ini file presented (2281). Thanks fbjorn for the PR.
  • Conditionless xfail markers no longer rely on the underlying test item
    being an instance of PyobjMixin, and can therefore apply to tests not
    collected by the built-in python test collector. Thanks barneygale_ for the
    PR.

.. _pfhayes: https://github.com/pfhayes
.. _bluetech: https://github.com/bluetech
.. _gst: https://github.com/gst
.. _sirex: https://github.com/sirex
.. _vidartf: https://github.com/vidartf
.. _kkoukiou: https://github.com/KKoukiou
.. _omerhadari: https://github.com/omerhadari
.. _fbjorn: https://github.com/fbjorn

.. _2248: pytest-dev/pytest#2248
.. _2137: pytest-dev/pytest#2137
.. _2160: pytest-dev/pytest#2160
.. _2231: pytest-dev/pytest#2231
.. _2234: pytest-dev/pytest#2234
.. _2238: pytest-dev/pytest#2238
.. _2281: pytest-dev/pytest#2281

.. _PEP-479: https://www.python.org/dev/peps/pep-0479/

3.0.6

==================

  • pytest no longer generates PendingDeprecationWarning from its own operations, which was introduced by mistake in version 3.0.5 (2118).
    Thanks to nicoddemus     for the report and RonnyPfannschmidt_ for the PR.
  • pytest no longer recognizes coroutine functions as yield tests (2129).
    Thanks to malinoff     for the PR.
  • Plugins loaded by the PYTEST_PLUGINS environment variable are now automatically
    considered for assertion rewriting (2185).
    Thanks nicoddemus     for the PR.
  • Improve error message when pytest.warns fails (2150). The type(s) of the
    expected warnings and the list of caught warnings is added to the
    error message. Thanks lesteve     for the PR.
  • Fix pytester internal plugin to work correctly with latest versions of
    zope.interface (1989). Thanks nicoddemus for the PR.
  • Assert statements of the pytester plugin again benefit from assertion rewriting (1920).
    Thanks RonnyPfannschmidt     for the report and nicoddemus_ for the PR.
  • Specifying tests with colons like test_foo.py::test_bar for tests in
    subdirectories with ini configuration files now uses the correct ini file
    (2148). Thanks pelme.
  • Fail testdir.runpytest().assert_outcomes() explicitly if the pytest
    terminal output it relies on is missing. Thanks to eli-b_ for the PR.

.. _barneygale: https://github.com/barneygale
.. _lesteve: https://github.com/lesteve
.. _malinoff: https://github.com/malinoff
.. _pelme: https://github.com/pelme
.. _eli-b: https://github.com/eli-b

.. _2118: pytest-dev/pytest#2118

.. _1989: pytest-dev/pytest#1989
.. _1920: pytest-dev/pytest#1920
.. _2129: pytest-dev/pytest#2129
.. _2148: pytest-dev/pytest#2148
.. _2150: pytest-dev/pytest#2150
.. _2185: pytest-dev/pytest#2185

3.0.5

==================

  • Add warning when not passing option=value correctly to -o/--override-ini (2105).
    Also improved the help documentation. Thanks to mbukatov     for the report and
    lwm_ for the PR.
  • Now --confcutdir and --junit-xml are properly validated if they are directories
    and filenames, respectively (2089_ and 2078). Thanks to lwm for the PR.
  • Add hint to error message hinting possible missing __init__.py (478). Thanks DuncanBetts.
  • More accurately describe when fixture finalization occurs in documentation (687). Thanks DuncanBetts.
  • Provide :ref: targets for recwarn.rst so we can use intersphinx referencing.
    Thanks to dupuy_ for the report and lwm_ for the PR.
  • In Python 2, use a simple +- ASCII string in the string representation of pytest.approx (for example &quot;4 +- 4.0e-06&quot;)
    because it is brittle to handle that in different contexts and representations internally in pytest
    which can result in bugs such as 2111. In Python 3, the representation still uses ± (for example 4 ± 4.0e-06).
    Thanks kerrick-lyft     for the report and nicoddemus_ for the PR.
  • Using item.Function, item.Module, etc., is now issuing deprecation warnings, prefer
    pytest.Function, pytest.Module, etc., instead (2034).
    Thanks nmundar     for the PR.
  • Fix error message using approx with complex numbers (2082).
    Thanks adler-j     for the report and nicoddemus_ for the PR.
  • Fixed false-positives warnings from assertion rewrite hook for modules imported more than
    once by the pytest_plugins mechanism.
    Thanks nicoddemus_ for the PR.
  • Remove an internal cache which could cause hooks from conftest.py files in
    sub-directories to be called in other directories incorrectly (2016).
    Thanks d-b-w     for the report and nicoddemus_ for the PR.
  • Remove internal code meant to support earlier Python 3 versions that produced the side effect
    of leaving None in sys.modules when expressions were evaluated by pytest (for example passing a condition
    as a string to pytest.mark.skipif)(2103).
    Thanks jaraco     for the report and nicoddemus_ for the PR.
  • Cope gracefully with a .pyc file with no matching .py file (2038). Thanks
    nedbat    .

.. _syre: https://github.com/syre
.. _adler-j: https://github.com/adler-j
.. _d-b-w: https://bitbucket.org/d-b-w/
.. _DuncanBetts: https://github.com/DuncanBetts
.. _dupuy: https://bitbucket.org/dupuy/
.. _kerrick-lyft: https://github.com/kerrick-lyft
.. _lwm: https://github.com/lwm
.. _mbukatov: https://github.com/mbukatov
.. _nedbat: https://github.com/nedbat
.. _nmundar: https://github.com/nmundar

.. _2016: pytest-dev/pytest#2016
.. _2034: pytest-dev/pytest#2034
.. _2038: pytest-dev/pytest#2038
.. _2078: pytest-dev/pytest#2078
.. _2082: pytest-dev/pytest#2082
.. _2089: pytest-dev/pytest#2089
.. _2103: pytest-dev/pytest#2103
.. _2105: pytest-dev/pytest#2105
.. _2111: pytest-dev/pytest#2111
.. _478: pytest-dev/pytest#478
.. _687: pytest-dev/pytest#687

3.0.4

==================

  • Import errors when collecting test modules now display the full traceback (1976).
    Thanks cwitty     for the report and nicoddemus_ for the PR.
  • Fix confusing command-line help message for custom options with two or more metavar properties (2004).
    Thanks okulynyak     and davehunt_ for the report and nicoddemus_ for the PR.
  • When loading plugins, import errors which contain non-ascii messages are now properly handled in Python 2 (1998).
    Thanks nicoddemus     for the PR.
  • Fixed cyclic reference when pytest.raises is used in context-manager form (1965). Also as a
    result of this fix, sys.exc_info() is left empty in both context-manager and function call usages.
    Previously, sys.exc_info would contain the exception caught by the context manager,
    even when the expected exception occurred.
    Thanks MSeifert04     for the report and the PR.
  • Fixed false-positives warnings from assertion rewrite hook for modules that were rewritten but
    were later marked explicitly by pytest.register_assert_rewrite
    or implicitly as a plugin (2005).
    Thanks RonnyPfannschmidt     for the report and nicoddemus_ for the PR.
  • Report teardown output on test failure (442).
    Thanks matclab     for the PR.
  • Fix teardown error message in generated xUnit XML.
    Thanks gdyuldin_ for the PR.
  • Properly handle exceptions in multiprocessing tasks (1984).
    Thanks adborden     for the report and nicoddemus_ for the PR.
  • Clean up unittest TestCase objects after tests are complete (1649).
    Thanks d_b_w     for the report and PR.

.. _adborden: https://github.com/adborden
.. _cwitty: https://github.com/cwitty
.. _d_b_w: https://github.com/d_b_w
.. _gdyuldin: https://github.com/gdyuldin
.. _matclab: https://github.com/matclab
.. _MSeifert04: https://github.com/MSeifert04
.. _okulynyak: https://github.com/okulynyak

.. _442: pytest-dev/pytest#442
.. _1965: pytest-dev/pytest#1965
.. _1976: pytest-dev/pytest#1976
.. _1984: pytest-dev/pytest#1984
.. _1998: pytest-dev/pytest#1998
.. _2004: pytest-dev/pytest#2004
.. _2005: pytest-dev/pytest#2005
.. _1649: pytest-dev/pytest#1649

3.0.3

==================

  • The ids argument to parametrize again accepts unicode strings
    in Python 2 (1905).
    Thanks philpep     for the report and nicoddemus_ for the PR.
  • Assertions are now being rewritten for plugins in development mode
    (pip install -e) (1934).
    Thanks nicoddemus     for the PR.
  • Fix pkg_resources import error in Jython projects (1853).
    Thanks raquel-ucl     for the PR.
  • Got rid of AttributeError: &#39;Module&#39; object has no attribute &#39;_obj&#39; exception
    in Python 3 (1944).
    Thanks axil     for the PR.
  • Explain a bad scope value passed to fixture declarations or
    a MetaFunc.parametrize() call. Thanks tgoodlet_ for the PR.
  • This version includes pluggy-0.4.0, which correctly handles
    VersionConflict errors in plugins (704).
    Thanks nicoddemus     for the PR.

.. _philpep: https://github.com/philpep
.. _raquel-ucl: https://github.com/raquel-ucl
.. _axil: https://github.com/axil
.. _tgoodlet: https://github.com/tgoodlet
.. _vlad-dragos: https://github.com/vlad-dragos

.. _1853: pytest-dev/pytest#1853
.. _1905: pytest-dev/pytest#1905
.. _1934: pytest-dev/pytest#1934
.. _1944: pytest-dev/pytest#1944
.. _704: pytest-dev/pytest#704

3.0.2

==================

  • Improve error message when passing non-string ids to pytest.mark.parametrize (1857).
    Thanks okken     for the report and nicoddemus_ for the PR.
  • Add buffer attribute to stdin stub class pytest.capture.DontReadFromInput
    Thanks joguSD_ for the PR.
  • Fix UnicodeEncodeError when string comparison with unicode has failed. (1864)
    Thanks AiOO     for the PR.
  • pytest_plugins is now handled correctly if defined as a string (as opposed as
    a sequence of strings) when modules are considered for assertion rewriting.
    Due to this bug, much more modules were being rewritten than necessary
    if a test suite uses pytest_plugins to load internal plugins (1888).
    Thanks jaraco     for the report and nicoddemus_ for the PR (1891_).
  • Do not call tearDown and cleanups when running tests from
    unittest.TestCase subclasses with --pdb
    enabled. This allows proper post mortem debugging for all applications
    which have significant logic in their tearDown machinery (1890). Thanks
    mbyt     for the PR.
  • Fix use of deprecated getfuncargvalue method in the internal doctest plugin.
    Thanks ViviCoder_ for the report (1898_).

.. _joguSD: https://github.com/joguSD
.. _AiOO: https://github.com/AiOO
.. _mbyt: https://github.com/mbyt
.. _ViviCoder: https://github.com/ViviCoder

.. _1857: pytest-dev/pytest#1857
.. _1864: pytest-dev/pytest#1864
.. _1888: pytest-dev/pytest#1888
.. _1891: pytest-dev/pytest#1891
.. _1890: pytest-dev/pytest#1890
.. _1898: pytest-dev/pytest#1898

3.0.1

==================

  • Fix regression when importorskip is used at module level (1822).
    Thanks jaraco     and The-Compiler_ for the report and nicoddemus_ for the PR.
  • Fix parametrization scope when session fixtures are used in conjunction
    with normal parameters in the same call (1832).
    Thanks The-Compiler     for the report, Kingdread_ and nicoddemus_ for the PR.
  • Fix internal error when parametrizing tests or fixtures using an empty ids argument (1849).
    Thanks OPpuolitaival     for the report and nicoddemus_ for the PR.
  • Fix loader error when running pytest embedded in a zipfile.
    Thanks mbachry_ for the PR.

.. _Kingdread: https://github.com/Kingdread
.. _mbachry: https://github.com/mbachry
.. _OPpuolitaival: https://github.com/OPpuolitaival

.. _1822: pytest-dev/pytest#1822
.. _1832: pytest-dev/pytest#1832
.. _1849: pytest-dev/pytest#1849

3.0.0

==================

Incompatible changes

A number of incompatible changes were made in this release, with the intent of removing features deprecated for a long
time or change existing behaviors in order to make them less surprising/more useful.

  • Reinterpretation mode has now been removed. Only plain and rewrite
    mode are available, consequently the --assert=reinterp option is
    no longer available. This also means files imported from plugins or
    conftest.py will not benefit from improved assertions by
    default, you should use pytest.register_assert_rewrite() to
    explicitly turn on assertion rewriting for those files. Thanks
    flub_ for the PR.
  • The following deprecated commandline options were removed:
  • --genscript: no longer supported;
  • --no-assert: use --assert=plain instead;
  • --nomagic: use --assert=plain instead;
  • --report: use -r instead;

Thanks to RedBeardCode_ for the PR (1664_).

  • ImportErrors in plugins now are a fatal error instead of issuing a
    pytest warning (1479). Thanks to The-Compiler for the PR.
  • Removed support code for Python 3 versions < 3.3 (1627_).
  • Removed all py.test-X* entry points. The versioned, suffixed entry points
    were never documented and a leftover from a pre-virtualenv era. These entry
    points also created broken entry points in wheels, so removing them also
    removes a source of confusion for users (1632).
    Thanks obestwalter     for the PR.
  • pytest.skip() now raises an error when used to decorate a test function,
    as opposed to its original intent (to imperatively skip a test inside a test function). Previously
    this usage would cause the entire module to be skipped (607).
    Thanks omarkohl     for the complete PR (1519_).
  • Exit tests if a collection error occurs. A poll indicated most users will hit CTRL-C
    anyway as soon as they see collection errors, so pytest might as well make that the default behavior (1421).
    A --continue-on-collection-errors option has been added to restore the previous behaviour.
    Thanks olegpidsadnyi     and omarkohl_ for the complete PR (1628_).
  • Renamed the pytest pdb module (plugin) into debugging to avoid clashes with the builtin pdb module.
  • Raise a helpful failure message when requesting a parametrized fixture at runtime,
    e.g. with request.getfixturevalue. Previously these parameters were simply
    never defined, so a fixture decorated like pytest.fixture(params=[0, 1, 2])
    only ran once (460).
    Thanks to nikratio     for the bug report, RedBeardCode_ and tomviner_ for the PR.
  • _pytest.monkeypatch.monkeypatch class has been renamed to _pytest.monkeypatch.MonkeyPatch
    so it doesn't conflict with the monkeypatch fixture.
  • --exitfirst / -x can now be overridden by a following --maxfail=N
    and is just a synonym for --maxfail=1.

New Features

  • Support nose-style __test__ attribute on methods of classes,
    including unittest-style Classes. If set to False, the test will not be
    collected.
  • New doctest_namespace fixture for injecting names into the
    namespace in which doctests run.
    Thanks milliams_ for the complete PR (1428_).
  • New --doctest-report option available to change the output format of diffs
    when running (failing) doctests (implements 1749).
    Thanks hartym     for the PR.
  • New name argument to pytest.fixture decorator which allows a custom name
    for a fixture (to solve the funcarg-shadowing-fixture problem).
    Thanks novas0x2a_ for the complete PR (1444_).
  • New approx() function for easily comparing floating-point numbers in
    tests.
    Thanks kalekundert_ for the complete PR (1441_).
  • Ability to add global properties in the final xunit output file by accessing
    the internal junitxml plugin (experimental).
    Thanks tareqalayan_ for the complete PR 1454_).
  • New ExceptionInfo.match() method to match a regular expression on the
    string representation of an exception (372).
    Thanks omarkohl     for the complete PR (1502_).
  • __tracebackhide__ can now also be set to a callable which then can decide
    whether to filter the traceback based on the ExceptionInfo object passed
    to it. Thanks The-Compiler_ for the complete PR (1526_).
  • New pytest_make_parametrize_id(config, val) hook which can be used by plugins to provide
    friendly strings for custom types.
    Thanks palaviv_ for the PR.
  • capsys and capfd now have a disabled() context-manager method, which
    can be used to temporarily disable capture within a test.
    Thanks nicoddemus_ for the PR.
  • New cli flag --fixtures-per-test: shows which fixtures are being used
    for each selected test item. Features doc strings of fixtures by default.
    Can also show where fixtures are defined if combined with -v.
    Thanks hackebrot_ for the PR.
  • Introduce pytest command as recommended entry point. Note that py.test
    still works and is not scheduled for removal. Closes proposal
    1629. Thanks obestwalter and davehunt_ for the complete PR
    (1633_).
  • New cli flags:
  • --setup-plan: performs normal collection and reports
    the potential setup and teardown and does not execute any fixtures and tests;
  • --setup-only: performs normal collection, executes setup and teardown of
    fixtures and reports them;
  • --setup-show: performs normal test execution and additionally shows
    setup and teardown of fixtures;
  • --keep-duplicates: py.test now ignores duplicated paths given in the command
    line. To retain the previous behavior where the same test could be run multiple
    times by specifying it in the command-line multiple times, pass the --keep-duplicates
    argument (1609_);

Thanks d6e, kvas-it, sallner, ioggstream and omarkohl_ for the PRs.

  • New CLI flag --override-ini/-o: overrides values from the ini file.
    For example: &quot;-o xfail_strict=True&quot;'.
    Thanks blueyed_ and fengxx_ for the PR.
  • New hooks:
  • pytest_fixture_setup(fixturedef, request): executes fixture setup;
  • pytest_fixture_post_finalizer(fixturedef): called after the fixture's
    finalizer and has access to the fixture's result cache.

Thanks d6e, sallner.

  • Issue warnings for asserts whose test is a tuple literal. Such asserts will
    never fail because tuples are always truthy and are usually a mistake
    (see 1562). Thanks kvas-it, for the PR.
  • Allow passing a custom debugger class (e.g. --pdbcls=IPython.core.debugger:Pdb).
    Thanks to anntzer_ for the PR.

Changes

  • Plugins now benefit from assertion rewriting. Thanks
    sober7, nicoddemus and flub_ for the PR.
  • Change report.outcome for xpassed tests to &quot;passed&quot; in non-strict
    mode and &quot;failed&quot; in strict mode. Thanks to hackebrot_ for the PR
    (1795) and gprasad84 for report (1546_).
  • Tests marked with xfail(strict=False) (the default) now appear in
    JUnitXML reports as passing tests instead of skipped.
    Thanks to hackebrot_ for the PR (1795_).
  • Highlight path of the file location in the error report to make it easier to copy/paste.
    Thanks suzaku_ for the PR (1778_).
  • Fixtures marked with pytest.fixture can now use yield statements exactly like
    those marked with the pytest.yield_fixture decorator. This change renders
    pytest.yield_fixture deprecated and makes pytest.fixture with yield statements
    the preferred way to write teardown code (1461).
    Thanks csaftoiu     for bringing this to attention and nicoddemus_ for the PR.
  • Explicitly passed parametrize ids do not get escaped to ascii (1351).
    Thanks ceridwen     for the PR.
  • Fixtures are now sorted in the error message displayed when an unknown
    fixture is declared in a test function.
    Thanks nicoddemus_ for the PR.
  • pytest_terminal_summary hook now receives the exitstatus
    of the test session as argument. Thanks blueyed_ for the PR (1809_).
  • Parametrize ids can accept None as specific test id, in which case the
    automatically generated id for that argument will be used.
    Thanks palaviv_ for the complete PR (1468_).
  • The parameter to xunit-style setup/teardown methods (setup_method,
    setup_module, etc.) is now optional and may be omitted.
    Thanks okken_ for bringing this to attention and nicoddemus_ for the PR.
  • Improved automatic id generation selection in case of duplicate ids in
    parametrize.
    Thanks palaviv_ for the complete PR (1474_).
  • Now pytest warnings summary is shown up by default. Added a new flag
    --disable-pytest-warnings to explicitly disable the warnings summary (1668_).
  • Make ImportError during collection more explicit by reminding
    the user to check the name of the test module/package(s) (1426).
    Thanks omarkohl     for the complete PR (1520_).
  • Add build/ and dist/ to the default --norecursedirs list. Thanks
    mikofski_ for the report and tomviner_ for the PR (1544_).
  • pytest.raises in the context manager form accepts a custom
    message to raise when no exception occurred.
    Thanks palaviv_ for the complete PR (1616_).
  • conftest.py files now benefit from assertion rewriting; previously it
    was only available for test modules. Thanks flub, sober7 and
    nicoddemus_ for the PR (1619_).
  • Text documents without any doctests no longer appear as "skipped".
    Thanks graingert_ for reporting and providing a full PR (1580_).
  • Ensure that a module within a namespace package can be found when it
    is specified on the command line together with the --pyargs
    option. Thanks to taschini_ for the PR (1597_).
  • Always include full assertion explanation during assertion rewriting. The previous behaviour was hiding
    sub-expressions that happened to be False, assuming this was redundant information.
    Thanks bagerard_ for reporting (1503). Thanks to davehunt and
    tomviner_ for the PR.
  • OptionGroup.addoption() now checks if option names were already
    added before, to make it easier to track down issues like 1618_.
    Before, you only got exceptions later from argparse library,
    giving no clue about the actual reason for double-added options.
  • yield-based tests are considered deprecated and will be removed in pytest-4.0.
    Thanks nicoddemus_ for the PR.
  • [pytest] sections in setup.cfg files should now be named [tool:pytest]
    to avoid conflicts with other distutils commands (see 567). [pytest] sections in
    pytest.ini or tox.ini files are supported and unchanged.
    Thanks nicoddemus     for the PR.
  • Using pytest_funcarg__ prefix to declare fixtures is considered deprecated and will be
    removed in pytest-4.0 (1684).
    Thanks nicoddemus     for the PR.
  • Passing a command-line string to pytest.main() is considered deprecated and scheduled
    for removal in pytest-4.0. It is recommended to pass a list of arguments instead (1723_).
  • Rename getfuncargvalue to getfixturevalue. getfuncargvalue is
    still present but is now considered deprecated. Thanks to RedBeardCode_ and tomviner_
    for the PR (1626_).
  • optparse type usage now triggers DeprecationWarnings (1740_).
  • optparse backward compatibility supports float/complex types (457_).
  • Refined logic for determining the rootdir, considering only valid
    paths which fixes a number of issues: 1594, 1435 and 1471.
    Updated the documentation according to current behavior. Thanks to
    blueyed    , davehunt_ and matthiasha_ for the PR.
  • Always include full assertion explanation. The previous behaviour was hiding
    sub-expressions that happened to be False, assuming this was redundant information.
    Thanks bagerard_ for reporting (1503). Thanks to davehunt and
    tomviner_ for PR.
  • Better message in case of not using parametrized variable (see 1539).
    Thanks to tramwaj29     for the PR.
  • Updated docstrings with a more uniform style.
  • Add stderr write for pytest.exit(msg) during startup. Previously the message was never shown.
    Thanks BeyondEvil_ for reporting 1210. Thanks to JonathonSonesen and
    tomviner_ for the PR.
  • No longer display the incorrect test deselection reason (1372).
    Thanks ronnypfannschmidt     for the PR.
  • The --resultlog command line option has been deprecated: it is little used
    and there are more modern and better alternatives (see 830).
    Thanks nicoddemus     for the PR.
  • Improve error message with fixture lookup errors: add an 'E' to the first
    line and '>' to the rest. Fixes 717. Thanks blueyed for reporting and
    a PR, eolo999_ for the initial PR and tomviner_ for his guidance during
    EuroPython2016 sprint.

Bug Fixes

  • Parametrize now correctly handles duplicated test ids.
  • Fix internal error issue when the method argument is missing for
    teardown_method() (1605_).
  • Fix exception visualization in case the current working directory (CWD) gets
    deleted during testing (1235). Thanks bukzor for reporting. PR by
    marscher_.
  • Improve test output for logical expression with brackets (925).
    Thanks DRMacIver     for reporting and RedBeardCode_ for the PR.
  • Create correct diff for strings ending with newlines (1553).
    Thanks Vogtinator     for reporting and RedBeardCode_ and
    tomviner_ for the PR.
  • ConftestImportFailure now shows the traceback making it easier to
    identify bugs in conftest.py files (1516). Thanks txomon for
    the PR.
  • Text documents without any doctests no longer appear as "skipped".
    Thanks graingert_ for reporting and providing a full PR (1580_).
  • Fixed collection of classes with custom __new__ method.
    Fixes 1579. Thanks to Stranger6667 for the PR.
  • Fixed scope overriding inside metafunc.parametrize (634).
    Thanks to Stranger6667     for the PR.
  • Fixed the total tests tally in junit xml output (1798).
    Thanks to cryporchild     for the PR.
  • Fixed off-by-one error with lines from request.node.warn.
    Thanks to blueyed_ for the PR.

.. _1210: pytest-dev/pytest#1210
.. _1235: pytest-dev/pytest#1235
.. _1351: pytest-dev/pytest#1351
.. _1372: pytest-dev/pytest#1372
.. _1421: pytest-dev/pytest#1421
.. _1426: pytest-dev/pytest#1426
.. _1428: pytest-dev/pytest#1428
.. _1435: pytest-dev/pytest#1435
.. _1441: pytest-dev/pytest#1441
.. _1444: pytest-dev/pytest#1444
.. _1454: pytest-dev/pytest#1454
.. _1461: pytest-dev/pytest#1461
.. _1468: pytest-dev/pytest#1468
.. _1471: pytest-dev/pytest#1471
.. _1474: pytest-dev/pytest#1474
.. _1479: pytest-dev/pytest#1479
.. _1502: pytest-dev/pytest#1502
.. _1503: pytest-dev/pytest#1503
.. _1516: pytest-dev/pytest#1516
.. _1519: pytest-dev/pytest#1519
.. _1520: pytest-dev/pytest#1520
.. _1526: pytest-dev/pytest#1526
.. _1539: pytest-dev/pytest#1539
.. _1544: pytest-dev/pytest#1544
.. _1546: pytest-dev/pytest#1546
.. _1553: pytest-dev/pytest#1553
.. _1562: pytest-dev/pytest#1562
.. _1579: pytest-dev/pytest#1579
.. _1580: pytest-dev/pytest#1580
.. _1594: pytest-dev/pytest#1594
.. _1597: pytest-dev/pytest#1597
.. _1605: pytest-dev/pytest#1605
.. _1616: pytest-dev/pytest#1616
.. _1618: pytest-dev/pytest#1618
.. _1619: pytest-dev/pytest#1619
.. _1626: pytest-dev/pytest#1626
.. _1627: pytest-dev/pytest#1627
.. _1628: pytest-dev/pytest#1628
.. _1629: pytest-dev/pytest#1629
.. _1632: pytest-dev/pytest#1632
.. _1633: pytest-dev/pytest#1633
.. _1664: pytest-dev/pytest#1664
.. _1668: pytest-dev/pytest#1668
.. _1684: pytest-dev/pytest#1684
.. _1723: pytest-dev/pytest#1723
.. _1740: pytest-dev/pytest#1740
.. _1749: pytest-dev/pytest#1749
.. _1778: pytest-dev/pytest#1778
.. _1795: pytest-dev/pytest#1795
.. _1798: pytest-dev/pytest#1798
.. _1809: pytest-dev/pytest#1809
.. _372: pytest-dev/pytest#372
.. _457: pytest-dev/pytest#457
.. _460: https://github.com/pytest-dev/pytes

@pyup-bot pyup-bot mentioned this pull request Nov 28, 2017
Closed
@pyup-bot
Copy link
Collaborator Author

pyup-bot commented Dec 6, 2017

Closing this in favor of #23

@pyup-bot pyup-bot closed this Dec 6, 2017
@SekouD SekouD deleted the pyup-update-pytest-2.9.2-to-3.3.0 branch December 6, 2017 10:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@pyup-bot