Full test automation of medical software, Vienna
In 2013 a vendor of medical software, located in Vienna, decided to achieve a ISO certification for the entire software development process. This certification should ensure that the high quality of the produced software – running in a sensible medical environment - should be verified at each step of the agile development process.
A key part of this certification takes quality assurance. In advance to the upcoming certification, the manufacturer decided to use Tricentis Tosca for test automation. Qcentris was able to show in a pilot in November 2013 that a two-step process according to the method of Linear Q™ is the most efficient approach. First, a test case design for all test cases based on the extensive and very detailed document with the functional specification is created. These so-called logical test cases are linked to the risk-weighted functional requirement structure in Tosca. In a 2nd step the automation of test cases is done. Here a test coverage with the highest possible value (very close to 100%) was strived for. Very comprehensive verifications and many negative test cases were planned, but nevertheless an explosion of number of test cases was avoided by the use of Linear Q™.
Qcentris could support this project between November 2013 and April 2014 with a team of three consultants in the areas of test automation and test case design. During the whole project a maximum cooperation with the internal test team, which was established and increased during the project. So the biggest challenges, namely the design of test cases as well as portfolio construction, infrastructure and Test Case Design were completed on schedule. The internal know-how for the test case automation was fully acquired, and the creation of the rest of the test cases can be settled by the customer without further external support.
Important solved issues in this project were:
- Difficult steering technology, which made it necessary to extend the steering of Tosca (this was implemented in cooperation with the manufacturer Tricentis)
- Fast knowledge acquisition in a technically highly complex environment to create the test case design
- Construction of an automatic adjustment of the functional specification with their mapping in Tosca
- Establishment of a test data system based on a resettable test database with synthetic data to obtain maximum repeatability of the automated test cases
- Ensuring a demonstrably unbroken (~ 100%) coverage of all requirements by the required 3,600 test cases with linking in Tricentis Tosca.
- Preparing an audit-proof stored and comprehensively documented test procedure for the ISO certification
In early April 2014, the ISO certification has been obtained: the test process that was designed in a cooperation with Qcentris and usage of Tricentis Tosca had convinced together.