Modernizing toolsets, centralizing automation, and establishing a consistent QA approach at a top Nordic bank

The group quickly discovered that over 40 different QA tools were being maintained by various groups. They covered all aspects of testing: test case management, test data provisioning, test automation, test environment management, test reporting, and more. Groups were also supporting multiple automation frameworks using different programming languages, creating significant overhead in terms of maintenance and inefficient delivery of automation across the bank.

“We realized we needed a strong foundation to base our test strategy on. We needed automated delivery of testing and automated execution of our QA process, our traceability, and our QA reporting,” says the Group Head of QA & Testing for the bank.

Specific challenges

• Diverse business landscape within the organization needed to be consolidated into a centralized QA group
• Wide variety of QA tooling and duplication of capabilities within the various teams – over 40 different test tools
• Multiple automation frameworks, tools, and approaches using different programming languages, causing huge overhead for maintenance and inefficient delivery across the bank
• Lack of efficient test case management solution – things were created multiple times in multiple areas, creating wasted effort and inconsistencies
• Needed to support Agile transformation without losing the existing value in legacy assets

“qTest was fulfilling every aspect of the success criteria. We made an official decision to move forward with qTest as the standard tool for the bank.”

– Head of QA Efficiency from the bank

The QA community from every department at the bank came together to contribute towards the selection of a standardized test management solution. They needed a single tool to bring together test process, test management, automation, and reporting to create a foundation for the future. The group established a list of key capabilities and success criteria for the tool selection process. The list included greater traceability of requirements, scalability, enablement of QA automation, reporting, integration with best-in-class automation tools, and the ability to support their Agile transformation.

A dedicated team representing different divisions of the bank set out to find the right test case management solution. After seven months of assessments, the group of 70 stakeholders agreed on Tricentis qTest as the test case management tool of choice for its ability to meet every key capability and a successful proof of concept.

Building a foundation of quality through test case management

qTest has become a central part of the bank’s SDLC. Test planning and test reporting as code are areas where qTest streamlines and manages the process. “qTest lies at the core of our automation effort,” explains the Head of QA Efficiency from the bank.

“We have already managed to implement automation into test planning and test reporting. In a matter of a few clicks, both the release test plan and the release test report can be generated in an automated way.” This goes a long way towards the bank’s goal of automating different QA activities that were once a time-consuming and manual process.

Quality gates are implemented around qTest. As part of the CI/CD pipeline, different quality gates ensure quality criteria are met at various points. When criteria are not met, the team is able to break the pipeline in order to address the underlying root cause of the issue quickly.

qTest’s webhook integration design with developer tool Atlassian Jira ensures a seamless transition from development to QA activities, and ensures the bank’s test process is translated to test management. Requirements that are developed in Jira are imported into qTest, where they are analyzed by the quality team for the test design phase to begin. “As soon as we link test cases to the requirements, we start traceability and start the measurement of quality,” says Ijaz.

Functional and non-functional testing are both planned in qTest across different test cycles, which also includes both manual and automated tests. Automated test frameworks interface with qTest for both test planning and results tracking. The quality process is monitored from development to delivery through the data tracked in test templates custom-designed by the the bank’s teams for qTest. Business-critical deliverables and status KPIs are generated for testing leaders through this process as well.

Today, the foundation for success is in place at the bank. Their focus is to use this foundation to drive their business goals of meeting their customers’ and business expectations. “Our customers are at the center of everything we do and that extends to QA as much as the rest of the business,” says the Group Head of QA & Testing at the bank.