Innovative User Acceptance Testing Service Saves Resources
Customer profile
The challenge
With limited experience as software testers and test script writers of a replacement LIMS implementation, a large pathology network is required to thoroughly and expeditiously complete user acceptance testing to deploy the standardised LIMS across 6 hospital trusts. To add to the complexity of the project, the network will replace 7 legacy systems and simultaneously harmonize 90%-95% of its clinical pathology processes.
The outcomes
High quality Clinisys WinPath LIMS deployment is achieved using Clinisys Testing Services, powered by the Cymetryc platform, to execute and manage the user acceptance testing (UAT) process. The network estimates that without this solution it would be required to double both the number of resources necessary to adequately validate the system as well as more than double the time to complete the UAT phase of the project.
“Slick” approach to automated and manual testing
“By far the biggest advantage of using the Cymetryc solution service is we know that the quality of our testing is higher and much more thorough than it would be had we been managing this on our own.”
Janine Bontoft, LIMS Implementation Manager, Department of Pathology, WYAAT
Clinisys WinPath Testing Services – powered by the Cymetryc platform
“From the outset it was clear that none of our WYAAT team are experienced software testers or test script writers, nor would they have accumulated the knowledge of the WinPath product to this point to be able to catch all the workflows and edge testing that is required for proper user acceptance testing (UAT), explains Janine Bontoft, LIMS Implementation Manager with the Department of Pathology at West Yorkshire. “Right from the start we recognized that Clinisys made a very good decision to include the Cymetryc platform and related services into our program. We decided early on in the project that all three groups: Clinisys, WYAAT and the Cymetryc team would work collaboratively throughout the process, and this level of teamwork became one of the secrets of our joint success.”
For WYAAT, the Cymetryc team delivered a service that included pathology-specific IT testing technologies and related services. For blood science, blood transfusion and cellular pathology disciplines, these included: test script writing, and test script execution. For microbiology, the Cymetryc team developed the test scripts for WYAAT who hired outside contractors to execute them using the Cymetryc Verify module.
As the Clinisys team prepared the discipline-specific low-level designs (LLDs) of the WinPath Enterprise LIMS based upon WYAAT’s requirements, the Cymetryc team applied its discipline-specific team to review them. The Cymetryc team then prepared the necessary test scripts that would exercise the WinPath Enterprise rules and workflows.
“The test scripts are executed by the Cymetryc team in logical discipline groupings so that the WYAAT team can begin to review the outcomes of the testing right away,” explained Janine. “Our team accessed the Cymetryc Approve module to review the completed testing. The data is presented to them on a single screen, including the associated screen print evidence. It is really quite slick.”
The Process
“Another big savings for us working with the Cymetryc solution service is that we had a partner that understood the process of testing inside and out and they organized with us an efficient process for completing this critical part of the project.“
Janine Bontoft, LIMS Implementation Manager, Department of Pathology, WYAAT
Over 2,800 test scripts created and executed by WYAAT
The key elements for Cymetryc solution testing service at WYAAT
- Risk Assessment
- Clinisys low level design (LLD) review
- Test script development service
- Test script execution service
- Cymetryc Verify module – desktop and cloud-based for documenting manual UAT
- Cymetryc Approve module – cloud-based portal for testing outcomes review
- Testing summary reports – automatic data collated, formatted, downloaded
- Testing detail reports – automatic data collated, formatted, screen prints included, downloaded
Outcomes
“Without a doubt our project would be at risk of massive project delays had we not been able to rely on the Cymetryc solution service for this project.”
Janine Bontoft, LIMS Implementation Manager, Department of Pathology, WYAAT
High Quality UAT Without ‘Doubling Our Resources’
“By far the biggest advantage of using the Cymetryc solution service is we know that the quality of our testing is higher and much more thorough than it would be had we been managing this on our own. The traceability, too, back to the Risk Assessment gives us the assurance that our testing requirements are covering all workflow requirements,” said Janine. “Without the Cymetryc solution service we could have expected to double our resources for this project. Even then, those resources would not likely have had the expertise of the Cymetryc team – regarding how to test, how to write test scripts and their understanding of the WinPath LIMS. We depended on their level of knowledge to ensure high quality and thorough testing.”
Pathology Team Engaged in Approvals.
Janine continues, “The advantage too has been that the Cymetryc solution service process relies on WYAAT to review the executed testing. The Cymetryc platform provides a cloud-based module, Cymetryc Approve, specifically for this purpose. In this way, we put our team through a rigorous review and approval process which has enabled them to clinically validate and ultimately approve the outcomes of testing. So, while our team may not have been on the front lines of developing or executing the test scripts, they have definitely reviewed and approved all of them. Cymetryc Approve requires them to verify and validate each step of each test script, all the while they are viewing collected screen print evidence as well. This really is the most efficient and cost-effective methodology.”
Significant Impact on Timeline
“Without a doubt,” Janine explains, “our project would be at risk of massive project delays had we not been able to rely on the Cymetryc solution service for this project. Certainly, our team were tentative at first, however once they understood the scope of the functional testing, how much could be off-loaded, and how they would still be active participants in the review, they realized its benefits. I don’t think pathology labs realize what a behemoth of a job software validation can be.”
Knowledgeable Partner Streamlined Process
“Another big savings for us working with the Cymetryc solution service is that we had a partner that understood the process of testing inside and out and they organized with us an efficient process for completing this critical part of the project,” said Janine.
Paperless Evidence of Compliance Reports
As testing is completed, the information and screen prints are automatically collated, formatted into well-organized reports including a Test Summary Report as well as the Test Detail Report. Throughout the WYAAT testing process, the Cymetryc platform captures the testing data, tester information and any screen print evidence information. At the end, these vital regulatory required reports can be instantly generated locally and saved to WYAAT share drives. “Had we been trying to create these reports manually they would have placed an enormous administrative burden on our resources,” Janine added.
Integrated Issues Management
“One item we identified early on was an inability to document issues within the Cymetryc platform,” explained Janine. “The Cymetryc team quickly took this challenge on board and within four months of our request, a Cymetryc integrated issues module was delivered. It allows us to document issues, track them, assign them, and close them. As issues get handled, the associated test scripts are re-executed to confirm the issue was successfully resolved. The complete testing history and issue resolution are captured in our final reports. Now that the Cymetryc Issues module is available to us, I use the Issues Report and Rejection Summaries to track the progress of addressing and correcting deficiencies as well as the retesting.”
Dashboard for monitoring progress and status
In her role as LIMS Implementation Manager, Janine used the Cymetryc dashboard to give her a quick status view of where things stood regarding how the pathology team were keeping up with their UAT approvals as testing was completed.
Future UAT Projects
Even after WYAAT completes this substantial LIMS project, it will face future UAT projects as analysers are replaced and other software is updated or added for which the Cymetryc solution service will be available for WYAAT to use.