Pytest

Pytest was developed as part of an effort by third-party packages to address Python's built-in module unittest's shortcomings. It originated as part of PyPy, an alternative implementation of Python to the standard CPython. Since its creation in early 2003, PyPy has had a heavy emphasis on testing. PyPy had unit tests for newly written code, regression tests for bugs, and integration tests using CPython's test suite.{{cite web |last1=Bolz-Tereick |first1=Carl Friedrich |title=PyPy Status Blog |url=https://morepypy.blogspot.com/2018/09/the-first-15-years-of-pypy.html#continuous-integration |website=PyPy |date=9 September 2018 |access-date=12 May 2022 |archive-date=6 July 2022 |archive-url=https://web.archive.org/web/20220706195902/https://morepypy.blogspot.com/2018/09/the-first-15-years-of-pypy.html#continuous-integration |url-status=live }}

In mid 2004, a testing framework called utest emerged and contributors to PyPy began converting existing test cases to utest. Meanwhile, at EuroPython 2004 a complementary standard library for testing, named std, was invented. This package laid out the principles, such as assert rewriting, of what would later become pytest. In late 2004, the std project was renamed to py, std.utest became py.test, and the py library was separated from PyPy. In November 2010, pytest 2.0.0 was released as a package separate from py. It was still called py.test until August 2016, but following the release of pytest 3.0.0 the recommended command line entry point became pytest.{{cite web |title=History |url=https://docs.pytest.org/en/latest/history.html |website=pytest |access-date=13 April 2022 |archive-date=16 May 2022 |archive-url=https://web.archive.org/web/20220516211537/https://docs.pytest.org/en/latest/history.html |url-status=live }}

Pytest has been classified by developer security platform Snyk as one of the key ecosystem projects in Python due to its popularity. Some well-known projects who switched to pytest from unittest and nose (another testing package) include those of Mozilla and Dropbox.{{cite web |title=Project examples |url=https://docs.pytest.org/en/6.2.x/projects.html |website=Pytest |access-date=1 February 2022 |archive-date=1 February 2022 |archive-url=https://web.archive.org/web/20220201223344/https://docs.pytest.org/en/6.2.x/projects.html |url-status=live }}{{cite web |last1=Koorapati |first1=Nipunn |title=Open Sourcing Pytest Tools |url=https://dropbox.tech/application/open-sourcing-pytest-tools |website=Dropbox |access-date=1 February 2022 |archive-date=11 June 2024 |archive-url=https://web.archive.org/web/20240611042915/https://dropbox.tech/application/open-sourcing-pytest-tools |url-status=live }}{{cite book |last1=Oliveira |first1=Bruno |title=pytest Quick Start Guide |date=August 2018 |publisher=Packt Publishing |isbn=978-1-78934-756-2 |url=https://www.packtpub.com/product/pytest-quick-start-guide/9781789347562 |access-date=1 February 2022 |archive-date=1 February 2022 |archive-url=https://web.archive.org/web/20220201231057/https://www.packtpub.com/product/pytest-quick-start-guide/9781789347562 |url-status=live }}{{cite web |title=pytest |url=https://snyk.io/advisor/python/pytest |website=Snyk |access-date=12 May 2022 |archive-date=27 June 2022 |archive-url=https://web.archive.org/web/20220627024337/https://snyk.io/advisor/python/pytest |url-status=live }}

It is a common pattern in software testing to send values through test functions and check for correct output. In many cases, in order to thoroughly test functionalities, one needs to test multiple sets of input/output, and writing such cases separately would cause duplicate code as most of the actions would remain the same, only differing in input/output values. Pytest's parametrized testing feature eliminates such duplicate code by combining different iterations into one test case, then running these iterations and displaying each test's result separately.{{cite book |last1=Okken |first1=Brian |title=Python Testing with Pytest |date=September 2017 |publisher=The Pragmatic Bookshelf |isbn=9781680502404 |edition=1st |url=https://pragprog.com/titles/bopytest/python-testing-with-pytest/ |access-date=22 January 2022 |archive-date=20 January 2022 |archive-url=https://web.archive.org/web/20220120135726/https://pragprog.com/titles/bopytest/python-testing-with-pytest/ |url-status=live }}

Parameterized tests in pytest are marked by the {{code|@pytest.mark.parametrize(argnames, argvalues)}} decorator, where the first parameter, {{code| argnames }}, is a string of comma-separated names, and {{code|argvalues}} is a list of values to pass into {{code| argnames }}. When there are multiple names in {{code| argnames }}, {{code|argvalues}} would be a list of tuples where values in each tuple corresponds to the names in {{code|argnames}} by index. The names in {{code|argnames}} are then passed into the test function marked by the decorator as parameters. When pytest runs such decorated tests, each pair of {{code| argnames }} and {{code|argvalues}} would constitute a separate run with its own test output and unique identifier. The identifier can then be used to run individual data pairs.{{r|okken|p=52–58}}{{cite web |title=Parametrizing fixtures and test functions |url=https://docs.pytest.org/en/6.2.x/parametrize.html |website=pytest.org |access-date=24 May 2022 |archive-date=4 June 2022 |archive-url=https://web.archive.org/web/20220604202736/https://docs.pytest.org/en/6.2.x/parametrize.html |url-status=live }}

When writing software tests, the assert statement is a primary means for communicating test failure, where expected values are compared to actual values.{{r|okken|p=32–34}} While Python's built-in assert keyword would only raise AssertionError with no details in cases of failure, pytest rewrites Python's assert keyword and provides detailed output for the causes of failures, such as what expressions in the assert statement evaluate to. A comparison can be made with unittest (Python's built-in module for testing)'s assert statements:{{r|okken|p=32}}

{{code| unittest }} adheres to a more verbose syntax because it is inspired by the Java programming language's JUnit, as are most unit testing libraries; pytest achieves the same while intercepting Python's built-in assert calls, making the approach more concise.{{r|okken|p=32}}

Pytest's tests verify that computer code performs as expected{{cite book |last1=Viafore |first1=Patrick |title=Robust Python |date=12 July 2021 |publisher=O'Reilly Media, Inc. |isbn=978-1-0981-0061-2 |url=https://books.google.com/books?id=mO43EAAAQBAJ&pg=PT313 |access-date=3 July 2022 |language=en |quote="Tests verify that what you build is performing as you expect." |archive-date=3 July 2022 |archive-url=https://web.archive.org/web/20220703205741/https://books.google.com/books?id=mO43EAAAQBAJ&pg=PT313 |url-status=live }} using tests that are structured in an arrange, act and assert sequence known as AAA. Its fixtures provide the context for tests. They can be used to put a system into a known state and to pass data into test functions. Fixtures practically constitute the arrange phase in the anatomy of a test (AAA, short for arrange, act, assert).{{cite book |last1=Khorikov |first1=Vladimir |title=Unit Testing Principles, Practices, and Patterns |date=January 2020 |publisher=Published by Manning Publications |isbn=9781617296277 |url=https://www.oreilly.com/library/view/unit-testing-principles/9781617296277/ |access-date=4 June 2022 |archive-date=4 June 2022 |archive-url=https://web.archive.org/web/20220604130844/https://www.oreilly.com/library/view/unit-testing-principles/9781617296277/ |url-status=live }} Pytest fixtures can run before test cases as setup or after test cases for clean up, but are different from unittest and nose (another third-party Python testing framework)'s setups and teardowns. Functions declared as pytest fixtures are marked by the {{code|@pytest.fixture}} decorator, whose names can then be passed into test functions as parameters.{{cite web |title=About fixtures |url=https://docs.pytest.org/en/latest/explanation/fixtures.html |website=Pytest |access-date=7 February 2022 |archive-date=7 February 2022 |archive-url=https://web.archive.org/web/20220207024326/https://docs.pytest.org/en/latest/explanation/fixtures.html |url-status=live }} When pytest finds the fixtures' names in test functions' parameters, it first searches in the same module for such fixtures, and if not found, it searches for such fixtures in the conftest.py file.{{r|okken|p=61}}

For example:

import pytest

@pytest.fixture

def dataset():

"""Return some data to test functions"""

return {'data1': 1, 'data2': 2}

def test_dataset(dataset):

"""test and confirm fixture value"""

assert dataset == {'data1': 1, 'data2': 2}

In the above example, pytest fixture {{code| dataset }} returns a dictionary, which is then passed into test function {{code| test_dataset }} for assertion. In addition to fixture detection within the same file as test cases, pytest fixtures can also be placed in the conftest.py file in the tests directory. There can be multiple conftest.py files, each placed within a tests directory for fixtures to be detected for each subset of tests.{{r|okken|p=63}}

In pytest, fixture scopes let the user define when a fixture should be called. There are four fixture scopes: function scope, class scope, module scope, and session scope. Function-scoped fixtures are default for all pytest fixtures, which are called every time a function having the fixture as a parameter runs. The goal of specifying a broader fixture scope is to eliminate repeated fixture calls, which could slow down test execution. Class-scoped fixtures are called once per test class, regardless of the number of times they are called, and the same logic goes for all other scopes. When changing fixture scope, one need only add the scope parameter to fixture decorators, for example, {{code|2=python|1=@pytest.fixture(scope="class")}}.{{r|okken|p=72}}{{cite book |last1=Ashwin |first1=Pajankar |title=Python Unit Test Automation: Practical Techniques for Python Developers and Testers |date=27 February 2017 |publisher=Apress |isbn=9781484226766 |url=https://www.oreilly.com/library/view/python-unit-test/9781484226766/ |access-date=7 March 2022 |archive-date=7 March 2022 |archive-url=https://web.archive.org/web/20220307035055/https://www.oreilly.com/library/view/python-unit-test/9781484226766/ |url-status=live }}

Another feature of pytest is its ability to filter through tests, where only desired tests are selected to run, or behave in a certain way as desired by the developer. With the "k" option (e.g. {{kbd|pytest -k some_name}}), pytest would only run tests whose names include {{code|some_name}}. The opposite is true, where one can run {{kbd|pytest -k "not some_name"}}, and pytest will run all tests whose names do not include {{code|some_name}}.{{cite book |last1=Molina |first1=Alessandro |title=Crafting Test-Driven Software with Python |date=February 2021 |publisher=Publisher(s): Packt Publishing |isbn=9781838642655 |url=https://www.oreilly.com/library/view/crafting-test-driven-software/9781838642655/ |access-date=8 March 2022 |archive-date=8 March 2022 |archive-url=https://web.archive.org/web/20220308025240/https://www.oreilly.com/library/view/crafting-test-driven-software/9781838642655/ |url-status=live }}

Pytest's markers can, in addition to altering test behaviour, also filter tests. Pytest's markers are Python decorators starting with the {{code|2=python|@pytest.mark.}} syntax placed on top of test functions. With different arbitrarily named markers, running {{kbd|pytest -m }} on the command line will only run those tests decorated with such markers.{{r|okken|p=13}} All available markers can be listed by the {{kbd|pytest --markers}} along with their descriptions; custom markers can also be defined by users and registered in pytest.ini, in which case {{kbd|pytest --markers}} will also list those custom markers along with builtin markers.{{r|okken|p=147}}

{{Portal|Free and open-source software}}

• JUnit, well-known software testing framework based on Java
• Doctest, well-known testing framework in Python for docstrings
• List of unit testing frameworks

{{Reflist}}

• {{Official website}}
• [https://pypi.org/project/pytest/ https://pypi.org/project/pytest/]
• [https://docs.pytest.org https://docs.pytest.org]

Category:Python (programming language) development tools

Category:Free software testing tools

Category:Unit testing frameworks