Black-box testing#Test coverage

Specification-based testing aims to test the functionality of software according to the applicable requirements.{{Cite thesis |last=Laycock |first=Gilbert T. |title=The Theory and Practice of Specification Based Software Testing |degree=dissertation |publisher=Department of Computer Science, University of Sheffield |url=http://www.cs.le.ac.uk/people/glaycock/thesis.pdf |year=1993 |access-date=January 2, 2018}} This level of testing usually requires thorough test cases to be provided to the tester, who then can simply verify that for a given input, the output value (or behavior), either "is" or "is not" the same as the expected value specified in the test case.File:Blackbox3D-withGraphs.svg

Specific knowledge of the application's code, internal structure and programming knowledge in general is not required.{{cite book |author=Milind G. Limaye |title=Software Testing |url=https://books.google.com/books?id=zUm8My7SiakC&pg=PA216 |year=2009 |publisher=Tata McGraw-Hill Education |isbn=978-0-07-013990-9 |pages=216}} The tester is aware of what the software is supposed to do but is not aware of how it does it. For instance, the tester is aware that a particular input returns a certain, invariable output but is not aware of how the software produces the output in the first place.{{cite book|title=Software Testing|last=Patton|first=Ron|publisher=Sams Publishing|year=2005|isbn=978-0672327988|edition=2nd|location=Indianapolis|url-access=registration|url=https://archive.org/details/softwaretesting0000patt}}

Test cases are built around specifications and requirements, i.e., what the application is supposed to do. Test cases are generally derived from external descriptions of the software, including specifications, requirements and design parameters. Although the tests used are primarily functional in nature, non-functional tests may also be used. The test designer selects both valid and invalid inputs and determines the correct output, often with the help of a test oracle or a previous result that is known to be good, without any knowledge of the test object's internal structure.

Typical black-box test design techniques include decision table testing, all-pairs testing, equivalence partitioning, boundary value analysis, cause–effect graph, error guessing, state transition testing, use case testing, user story testing, domain analysis, and syntax testing.{{Cite book|title=Practical Test Design: Selection of Traditional and Automated Test Design Techniques |first1=István|last1=Forgács|first2=Attila|last2=Kovács |year=2019 |publisher=BCS Learning & Development Limited |isbn=978-1780174723}}{{Cite book |last=Black, R. |url=https://books.google.com/books?id=n-bTHNW97kYC&pg=PA44 |title=Pragmatic Software Testing: Becoming an Effective and Efficient Test Professional |publisher=John Wiley & Sons |year=2011 |isbn=978-1-118-07938-6 |pages=44–6}}

{{Redirects|Test coverage|coverage based on source code|Code coverage}}

Test coverage refers to the percentage of software requirements that are tested by black-box testing for a system or application.{{Cite tech report|number=610.12-1990|date=1990|institution=IEEE|title=IEEE Standard Glossary of Software Engineering Terminology}} This is in contrast with code coverage, which examines the inner workings of a program and measures the degree to which the source code of a program is executed when a test suite is run.{{Cite web |title=Code Coverage vs Test Coverage |url=https://www.browserstack.com/guide/code-coverage-vs-test-coverage |access-date=2024-04-13 |website=BrowserStack |language=en-US}} Measuring test coverage makes it possible to quickly detect and eliminate defects, to create a more comprehensive test suite. and to remove tests that are not relevant for the given requirements.{{Cite web |last=Andrades |first=Geosley |date=2023-12-16 |title=Top 8 Test Coverage Techniques in Software Testing |url=https://www.accelq.com/blog/test-coverage-techniques/ |access-date=2024-04-13 |website=ACCELQ Inc |language=en-GB}}

Black-box testing may be necessary to assure correct functionality, but it is insufficient to guard against complex or high-risk situations.{{Cite journal |last=Bach |first=James |author-link=James Bach |date=June 1999 |title=Risk and Requirements-Based Testing |url=http://www.satisfice.com/articles/requirements_based_testing.pdf |journal=Computer |volume=32 |issue=6 |pages=113–114 |access-date=August 19, 2008}} An advantage of the black box technique is that no programming knowledge is required. Whatever biases the programmers may have had, the tester likely has a different set and may emphasize different areas of functionality. On the other hand, black-box testing has been said to be "like a walk in a dark labyrinth without a flashlight."{{Cite book |last=Savenkov |first=Roman |title=How to Become a Software Tester |publisher=Roman Savenkov Consulting |year=2008 |isbn=978-0-615-23372-7 |page=159}} Because they do not examine the source code, there are situations when a tester writes many test cases to check something that could have been tested by only one test case or leaves some parts of the program untested.

{{div col|colwidth=20em}}

• ABX test
• Acceptance testing
• Blind experiment
• Boundary testing
• Fuzz testing
• Gray box testing
• Metasploit Project
• Sanity testing
• Smoke testing
• Software performance testing
• Software testing
• Stress testing
• Test automation
• Unit testing
• Web application security scanner
• White hat hacker
• White-box testing

{{div col end}}

{{Reflist}}

• BCS SIGIST (British Computer Society Specialist Interest Group in Software Testing): [http://www.testingstandards.co.uk/Component%20Testing.pdf Standard for Software Component Testing], Working Draft 3.4, 27. April 2001.

{{Software testing}}

{{DEFAULTSORT:Black-Box Testing}}

Category:Software testing

Category:Hardware testing