105 Types of Software Testing Every Tester Should KnowCigniti Technologies
Due to businesses embracing digital platforms, mobile, big-data, social media, cloud and the internet of things, there has been a definite rise in software services. With agile methodology, testing is introduced earlier on in the software lifecycle.
- The past few years have witnessed an exponential growth in the number and variety of consumer and enterprise mobile applications, and this shift to a mobile platform in every industry is expected to re-engineer businesses for mobile responsiveness.
- Real-time scalability challenges, instant data collection and deployment, and an increasing need for live integration of information, are some of the needs and challenges that make it imperative for Big Data applications to be tested thoroughly. Cigniti leverages its experience of having tested large scale data warehousing and business intelligence applications to offer a host of Big Data Testing services and solutions.
- Over the last decade, how internet is being leveraged and used has undergone a major shift with the advent of Smart Phones and Tablet Computers. This shift has caused a “Big Transformation” in the e-commerce industry, as it has dramatically changed consumer behavior and moved them away from transacting traditionally. Consumer base and expectations have grown manifold. Consumers expect e-commerce platforms to be smarter, faster, and more secure.
In this post, we address the various types of software testing. Software testing is of different types, and they are all performed in order to achieve different objectives when testing a software application. It is a general misconception that software testing is usually only performed by specialized testing teams. While this holds true for almost all cases of testing, there are still significant types of testing that end-users, developers, and specially configured systems in certain organizations would need to perform. The well-known list of 105 types of testing has been categorically split according to the teams in charge of conducting those types of software testing.
Testing Conducted by Users
- Acceptance Testing:A formal testing conducted to determine whether or not a system complies with business requirements, and to assess if it meets the acceptance criteria for delivery. It enables the customer to determine whether or not to accept the system, and is usually performed by the customer.
- Accessibility Testing:A subset of usability testing, it is a type of testing which determines the how usable a product is, specifically to the people with hearing, speech, sight and other kinds of disabilities. The evaluation process is conducted by persons having disabilities.
- Alpha Testing:Type of testing a software product or system conducted at the developer’s site. Usually it is performed by the end user.
- Beta Testing:Final testing before releasing application for commercial purpose. It is typically done by end-users or others.
- Usability Testing:Testing technique which verifies the ease with which a user can learn to operate, prepare inputs for, and interpret outputs of a system or component. It is usually performed by end users.
Testing Conducted by Manual Testers and Testing Teams
- Active Testing:A type of testing consisting of introducing test data and analyzing the execution results. It is usually conducted by the testing teams.
- Age Testing:Type of testing which evaluates a system’s ability to perform in the future. The evaluation process is conducted by testing teams.
- Ad-hoc Testing:Testing performed without planning and documentation – the tester tries to ‘break’ the system by randomly trying the system’s functionality.
- Assertion Testing:Type of testing consisting in verifying if the conditions confirm the product requirements.
- All-pairs Testing:Combinatorial testing method that tests all possible discrete combinations of input parameters.
- Basis Path Testing:A testing mechanism which derives a logical complexity measure of a procedural design and use this as a guide for defining a basic set of execution paths. It is used by testing teams when defining test cases.
- Backward Compatibility Testing:Testing method which verifies the behavior of the developed software with older versions of the test environment.
- Benchmark Testing:Testing technique that uses representative sets of programs and data designed to evaluate the performance of computer hardware and software in a given configuration.
- Big Bang Integration Testing:Testing technique which integrates individual program modules only when everything is ready.
- Binary Portability Testing:Technique that tests an executable application for portability across system platforms and environments, usually for conformation to an ABI specification.
- Boundary Value Testing:Software testing technique in which tests are designed to include representatives of boundary values. It is performed by the QA testing teams.
- Bottom up Integration Testing:In bottom up integration testing, module at the lowest level are developed first and other modules which go towards the ‘main’ program are integrated and tested one at a time. It is usually performed by the testing teams.
- Breadth Testing:A test suite that exercises the full functionality of a product but does not test features in detail.
- Compatibility Testing:Testing technique that validates how well a software performs in a particular hardware/software/operating system/network environment.
- Condition Coverage Testing:Type of software testing where each condition is executed by making it true and false, in each of the ways at least once. It is typically made by the automation testing teams.
- Conformance Testing:The process of testing that an implementation conforms to the specification on which it is based. It is usually performed by testing teams.
- Context Driven Testing:An Agile Testing technique that advocates continuous and creative evaluation of testing opportunities in light of the potential information revealed and the value of that information to the organization at a specific moment. It is usually performed by Agile testing teams.
- Decision Coverage Testing:Type of software testing where each condition/decision is executed by setting it on true/false. It is typically made by the automation testing teams.
- Destructive Testing:Type of testing in which the tests are carried out to the specimen’s failure, in order to understand a specimen’s structural performance or material behavior under different loads. It is usually performed by QA teams.
- Dependency Testing:Testing type which examines an application’s requirements for pre-existing software, initial states, and configuration in order to maintain proper functionality. It is usually performed by testing teams.
- Dynamic Testing:Term used in software engineering to describe the testing of the dynamic behavior of code. It is typically performed by testing teams.
- Domain Testing:White box testing technique which contains checking that the program accepts only valid input. It is usually done by software development teams and occasionally by automation testing teams.
- Error-Handling Testing:Software testing type which determines the ability of the system to properly process erroneous transactions. It is usually performed by the testing teams.
- Exploratory Testing:Black box testing technique performed without planning and documentation. It is usually performed by manual testers.
- Functional Testing:Type of black box testing that bases its test cases on the specifications of the software component under test.
- Fuzz Testing:Software testing technique that provides invalid, unexpected, or random data to the inputs of a program – a special area of mutation testing. Fuzz testing is performed by testing teams.
- GUI Software Testing:The process of testing a product that uses a graphical user interface, to ensure it meets its written specifications. This is normally done by the testing teams.
- Globalization Testing:Testing method that checks proper functionality of the product with any of the culture/locale settings using every type of international input possible.
- Hybrid Integration Testing:Testing technique which combines top-down and bottom-up integration techniques in order leverage benefits of these kind of testing. It is usually performed by the testing teams.
- Integration Testing:The phase in software testing in which individual software modules are combined and tested as a group. It is usually conducted by testing teams.
- Internationalization Testing:The process which ensures that product’s functionality is not broken and all the messages are properly externalized when used in different languages and locale. It is usually performed by the testing teams.
- Inter-Systems Testing:Testing technique that focuses on testing the application to ensure that interconnection between application functions correctly. It is usually done by the testing teams.
- Keyword-driven Testing:Also known as table-driven testing or action-word testing, is a software testing methodology for automated testing that separates the test creation process into two distinct stages: Planning Stage and Implementation Stage. It can be used by either manual or automation testing teams.
- Localization Testing:Part of software testing process focused on adapting a globalized application to a particular culture/locale. It is normally done by the testing teams.
- Manual Scripted Testing:Testing method in which the test cases are designed and reviewed by the team before executing it. It is done by manual testing teams.
- Manual-Support Testing:Testing technique that involves testing of all the functions performed by the people while preparing the data and using these data from automated system. It is conducted by testing teams.
- Model-Based Testing:The application of Model based design for designing and executing the necessary artifacts to perform software testing. It is usually performed by testing teams.
- Mutation Testing:Method of software testing that involves modifying programs’ source code or byte code in small ways in order to test sections of the code that are seldom or never accessed during normal tests execution. It is normally conducted by testers.
- Modularity-driven Testing:Software testing technique which requires the creation of small, independent scripts that represent modules, sections, and functions of the application under test. It is usually performed by the testing team.
- Non-functional Testing:Testing technique which focuses on testing of a software application for its non-functional requirements. Can be conducted by the performance engineers or by manual testing teams.
- Negative Testing:Also known as “test to fail” – testing method where the tests’ aim is showing that a component or system does not work. It is performed by manual or automation testers.
- Operational Testing:Testing technique conducted to evaluate a system or component in its operational environment. Usually
- Orthogonal Array Testing:Systematic, statistical way of testing which can be applied in user interface testing, system testing, regression testing, configuration testing, and performance testing.
- Passive Testing:Testing technique consisting in monitoring the results of a running system without introducing any special test data.
- Parallel Testing:Testing technique to ensure that a new application which has replaced its older version has been installed and is running correctly. It is conducted by the testing team.
- Regression Testing:Type of software testing that seeks to uncover software errors after changes to the program (e.g. bug fixes or new functionality) have been made, by retesting the program.
- Recovery Testing:Testing technique that evaluates how well a system recovers from crashes, hardware failures, or other catastrophic problems.
- Sanity Testing:Testing technique that determines if a new software version is performing well enough to accept it for a major testing effort.
- Scenario Testing:Testing activity that uses scenarios based on a hypothetical story to help a person think through a complex problem or system for a testing environment.
- Storage Testing:Testing type that verifies the program under test stores data files in the correct directories and that it reserves sufficient space to prevent unexpected termination resulting from lack of space. It is usually performed by the testing team.
- System integration Testing: Testing process that exercises a software system’s coexistence with others. It is usually performed by the testing teams.
- Top down Integration Testing: Testing technique that involves starting at the stop of a system hierarchy at the user interface and using stubs to test from the top down until the entire system has been implemented. It is conducted by the testing teams.
- Thread Testing: A variation of top-down testing technique where the progressive integration of components follows the implementation of subsets of the requirements. It is usually performed by the testing teams.
- Upgrade Testing: Testing technique that verifies if assets created with older versions can be used properly and that user’s learning is not challenged.
- User Interface Testing: Type of testing which is performed to check how user-friendly the application is.
- Workflow Testing: Scripted end-to-end testing technique which duplicates specific workflows which are expected to be utilized by the end-user. It is usually conducted by testing teams.
Testing Conducted by QA Engineers
- Agile Testing:Software testing practice that follows the principles of the agile manifesto, emphasizing testing from the perspective of customers who will utilize the system. It is usually performed by the QA teams.
- API Testing:Testing technique similar to unit testing in that it targets the code level. API Testing differs from unit testing in that it is typically a QA task and not a developer task.
- Black box Testing:A method of software testing that verifies the functionality of an application without having specific knowledge of the application’s code/internal structure. Tests are based on requirements and functionality. It is performed by QA teams.
- Conversion Testing:Testing of programs or procedures used to convert data from existing systems for use in replacement systems. It is usually performed by the QA teams.
- End-to-end Testing:Similar to system testing, involves testing of a complete application environment in a situation that mimics real-world use, such as interacting with a database, using network communications, or interacting with other hardware, applications, or systems if appropriate. It is performed by QA teams.
- Equivalence Partitioning Testing:Software testing technique that divides the input data of a software unit into partitions of data from which test cases can be derived. It is usually performed by the QA teams.
- Fault injection Testing:Element of a comprehensive test strategy that enables the tester to concentrate on the manner in which the application under test is able to handle exceptions. It is performed by QA teams.
- Formal verification Testing:The act of proving or disproving the correctness of intended algorithms underlying a system with respect to a certain formal specification or property, using formal methods of mathematics. It is usually performed by QA teams.
- Gorilla Testing:Software testing technique which focuses on heavily testing of one particular module. It is performed by quality assurance teams, usually when running full testing.
- Install/Uninstall Testing:Quality assurance work that focuses on what customers will need to do to install and set up the new software successfully. It may involve full, partial or upgrades install/uninstall processes and is typically done by the software testing engineer in conjunction with the configuration manager.
- Requirements Testing:Testing technique which validates that the requirements are correct, complete, unambiguous, and logically consistent and allows designing a necessary and sufficient set of test cases from those requirements. It is performed by QA teams.
Testing Conducted by Performance Testing Engineers
- Configuration Testing:Testing technique that determines minimal and optimal configuration of hardware and software, and the effect of adding or modifying resources such as memory, disk drives and CPU.
- Concurrency Testing:Multi-user testing geared towards determining the effects of accessing the same application code, module or database records.
- Endurance Testing:Type of testing that checks for memory leaks or other problems that may occur with prolonged execution.
- Load Testing:Testing technique that puts demand on a system or device and measures its response. It is usually conducted by the performance engineers.
- Performance Testing:Testing conducted to evaluate the compliance of a system or component with specified performance requirements.
- Ramp Testing:Type of testing consisting in raising an input signal continuously until the system breaks down. It may be conducted by the testing team or the performance engineer.
- Scalability Testing:Part of the battery of non-functional tests which tests a software application for measuring its capability to scale up – be it the user load supported, the number of transactions, the data volume etc.
- Stability Testing:Testing technique that attempts to determine if an application will crash.
- Stress Testing:Testing technique that evaluates a system or component at or beyond the limits of its specified requirements.
- Volume Testing:Testing which confirms that any values that become large over time (such as accumulated counts, logs, and data files), can be accommodated by the program and will not cause the program to stop working or degrade its operation in any manner.
Testing done by Developer Teams
- Branch Testing:Testing technique in which all branches in the program source code are tested at least once. This is done by the developer.
- Code-driven Testing:Testing technique that uses testing frameworks (such as xUnit) that allow the execution of unit tests to determine whether various sections of the code are acting as expected under various circumstances. It is performed by the development teams.
- Comparison Testing:Testing technique which compares the product strengths and weaknesses with previous versions or other similar products. This can be performed by tester, developers, product managers or product owners.
- Component Testing:Testing technique similar to unit testing but with a higher level of integration – testing is done in the context of the application instead of just directly testing a specific method. This can be performed by testing or development teams.
- Gray Box Testing:A combination of Black Box and White Box testing methodologies: testing a piece of software against its specification but using some knowledge of its internal workings. It can be performed by either development or testing teams.
- Glass box Testing:Similar to white box testing, based on knowledge of the internal logic of an application’s code. It is performed by development teams.
- Interface Testing:Testing conducted to evaluate whether systems or components pass data and control correctly to one another. It is usually performed by both testing and development teams.
- Loop Testing:A white box testing technique that exercises program loops. It is performed by the development teams.
- Pair Testing:Software development technique in which two team members work together at one keyboard to test the software application. One does the testing and the other analyzes or reviews the testing. This can be done between one Tester and Developer or Business Analyst or between two testers with both participants taking turns at driving the keyboard.
- Path Testing:Typical white box testing which has the goal to satisfy coverage criteria for each logical path through the program.
- Qualification Testing:Testing against the specifications of the previous release, usually conducted by the developer for the consumer, to demonstrate that the software meets its specified requirements.
- Statement Testing:White box testing which satisfies the criterion that each statement in a program is executed at least once during program testing.
- Static Testing:A form of software testing where the software isn’t actually used it checks mainly for the sanity of the code, algorithm, or document. It is used by the developer who wrote the code.
- Structural Testing:White box testing technique which takes into account the internal structure of a system or component and ensures that each program statement performs its intended function. It is usually performed by the software developers.
- System Testing:The process of testing an integrated hardware and software system to verify that the system meets its specified requirements. It is conducted by the testing teams in both development and target environment.
- Unit Testing:Software verification and validation method in which a programmer tests if individual units of source code are fit for use. It is usually conducted by the development team.
- White box Testing:Testing technique based on knowledge of the internal logic of an application’s code and includes tests like coverage of code statements, branches, paths, conditions.
- Automated Testing:Testing technique that uses automation testing tools to control the environment set-up, test execution and results reporting.
- Compliance Testing:Type of testing which checks whether the system was developed in accordance with standards, procedures and guidelines. It is usually performed by external companies which offer “Certified OGC Compliant” brand.
- Penetration Testing:Testing method which evaluates the security of a computer system or network by simulating an attack from a malicious source. Usually they are conducted by specialized penetration testing companies.
- Security Testing:A process to determine that an information system protects data and maintains functionality as intended. It can be performed by testing teams or by specialized security-testing companies.
- Smoke Testing:Testing technique which examines all the basic components of a software system to ensure that they work properly. Typically, smoke testing is conducted by the testing team, immediately after a software build is made.
- Vulnerability Testing:Type of testing which regards application security and has the purpose to prevent problems which may affect the application integrity and stability. It can be performed by the internal testing teams or outsourced to specialized companies.
Cigniti Technologies is a global leader for independent software testing services. Cigniti has established itself firmly in the niche area of software testing and has partnered with tool-specific software testing vendors in order to guarantee specialized testing services across all industries. In the age of digitization of businesses, as organizations are increasingly adopting agile methodologies, Cigniti’s Quality Assurance Engineers take part right from the early stages of the software life cycle.
To know more about Cigniti, visit our website.