Performance Testing

Performance testing is testing that measures an implementation's performance characteristics, such as throughput and responsiveness, under various conditions. This is the wording used in ISO/IEC 21122-4:2020, which treats it as a distinct kind of test applied to an implementation under test.

The term is broad. It is not a single procurement-specific abbreviation, and what gets measured depends on the product or system being tested. A software platform, an RFID tag and an air conditioner each have their own performance characteristics and their own test methods, so a solicitation that calls for performance testing relies on the test procedures and standards it names.

The ISO/IEC 21122-4 definition of performance testing

ISO/IEC 21122-4:2020 states that performance testing measures the performance characteristics of an implementation under test. Throughput and responsiveness are the examples it gives, and the measurements are taken under various conditions rather than a single fixed setting. The standard is the direct source for the general wording of the term. You can review it on the ISO page for ISO/IEC 21122-4.

Performance testing of software systems under ISO/IEC 14756

In software and information systems, performance testing concerns measurable characteristics such as execution speed, throughput, responsiveness and timeliness. ISO/IEC 14756 defines methods for measuring and rating the user-oriented performance of computer-based software systems. It identifies execution time, throughput and timeliness as the performance values for that purpose.

Performance tests for RFID tags and air conditioners

The same term carries product-specific meanings in equipment procurement. ISO/IEC 18046-3 specifies performance test methods for RFID tags used in item-management applications. Its results allow RFID systems, interrogators and tags to be compared for selection in a particular application. The standard does not apply to testing for regulatory or similar requirements, so performance tests and compliance tests are kept apart.

ISO 15042 applies the term to a different product class. It specifies performance testing, standard conditions and test methods for determining the capacity and efficiency ratings of air-cooled air conditioners and air-to-air heat pumps.

Performance testing versus vendor performance management at PSPC

In Canadian federal contracting, a related expression is easy to confuse with the technical term. Public Services and Procurement Canada (PSPC) runs a vendor performance program that evaluates a supplier's conduct on a contract. Its Vendor Performance Management Policy applies to new PSPC requests for proposals and non-competitive contracts for goods and services valued above $100,000, where PSPC manages both the procurement process and the resulting contract. Evaluations use standardized categories: cost, quality, schedule and management.

Covered solicitations and contracts must include standard clauses telling vendors that their performance will be evaluated. Under the archived policy, interim evaluations take place at least every six months, with a final evaluation at contract end. Special timing applies to short contracts and to contracts whose first deliverable falls more than six months out. These provisions evaluate the supplier, not the technical performance of a product or system.

What performance testing means for a supplier bidding on Canadian public contracts

Read the exact wording in each solicitation. Where it calls for performance testing, your obligations come from the statement of work, acceptance criteria, test procedures, referenced standards and reporting requirements. Confirm which characteristics are measured, under what conditions, and what result counts as acceptance. Keep this separate from vendor performance evaluation, which applies to covered PSPC contracts and scores your delivery on cost, quality, schedule and management.