Operational acceptance testing (OAT) is used to conduct operational readiness (pre-release) of a product, service, or system as part of a quality management system. OAT is a common type of non-functional software testing, used mainly in software development and software maintenance projects. This type of testing focuses on the operational readiness of the system to be supported, and/or to become part of the production environment. Hence, it is also known as operational readiness testing (ORT) or operations readiness and assurance testing(OR&A). Functional testing within OAT is limited to those tests which are required to verify the non-functional aspects of the system.
According to the International Software Testing Qualifications Board (ISTQB), OAT may include checking the backup/restore facilities, IT disaster recovery procedures, maintenance tasks and periodic check of security vulnerabilities., and whitepapers on ISO 29119 and Operational Acceptance by Anthony Woods, and ISO 25000 and Operational Acceptance Testing by Dirk Dach et al.
An approach used in operational readiness testing (OAT) may follow these steps:
- Design the system,
- Assess the design,
- Build the system,
- Confirm if built to design,
- Evaluate the system addresses business functional requirements,
- Assess the system for compliance with non-functional requirements,
- Deploy the system,
- Assess operability and supportability of the system.
Benchmark-SW for Windows-Systems
- 3DMark Fire Strike (download)
- FireStrike (1080p) Benchmark
- Unigine Superposition (download)
- 1080p Extreme Benchmark
- PCMark 10 Professional (download)
- Express Benchmark
- WPrime (download)
- 32M and 1024M
- Power usage recorded at 1024M 50% complete, thermals recorded at 75%
- CineBench R15 (download)
- CPU Multi
- CPU Single
- Handbrake (download)
- Custom MP4 to MKV 4K conversion (details below)
- AIDA64 Engineer (download)
- CPU-Z (download)
- HWMonitor (download)
To stress processors to their absolute limit and accurately judge their performance in video editing workloads, we transcode a 7.7GB compilation of gaming footage; this particular file is freely available from here. The captured footage is 22 minutes and 12 seconds long, it has a bit rate of 50.1 Mbps and it uses the Advanced Video Codec. Additionally, the video runs at a constant 30 frames-per-second and opts for a 3820 x 2140 (4K) resolution. Once loaded into Handbrake, we then transcode the 4K MP4 to an MKV file using the “normal” profile.
A rest period of 2-5 minutes is observed between each piece of software allowing the system to return to its idle power usage and temperatures. Background services like Windows Update are checked to not be running during the testing period by setting WiFi to Metered Connection.