Le Livre Scolaire

How Le Livre Scolaire delivers higher quality educational experiences with Testim Copilot

Company overview

Le Livre Scolaire, a pioneering French company in educational workbooks and resources, embraced Tricentis Testim to overcome challenges in web test automation. By transitioning to Testim, they reduced test creation time, improved reliability, and empowered non-technical team members to actively participate in quality assurance processes.

In the heart of Lyon, France, Le Livre Scolaire (part of Hachette Livre) has been redefining education since 2009. Their textbooks, crafted with teachers and for teachers, support schools across metropolitan France and beyond. With interactive and customizable digital textbooks on a variety of subjects, they’ve become trailblazers in the field, with a mission to make learning accessible, innovative, and collaborative. As their digital learning platform transitioned to meet the growing demands of educators in a digital-first world, ensuring its reliability became paramount.

When Matthieu Brunerie joined Le Livre Scolaire as Quality Manager, the team was already aware of the challenges they faced with their testing processes. The previous testing tool, Testsigma, had significant limitations. Tests were not only cumbersome to create but also challenging to maintain, often requiring significant rework from release to release. Running these tests was equally problematic: sequences took hours to execute, and the inability to parallelize meant inefficiencies compounded. Moreover, with a biweekly release schedule, any delay risked affecting teachers relying on the platform for their classrooms.

  • Arrow Icon
    Industry: Education
  • Arrow Icon
    Organization size: 130
  • Arrow Icon
    Location: France
  • Arrow IconProducts:

Challenges

  • Le Livre Scolaire had a hard time sticking to its biweekly release cycle because of their slow former testing tool.
  • Test cases were hard to maintain, and all changes within existing tests required deep Java knowledge.
  • Test runs were not parallelized.

Instilling confidence in the quality assurance process

For Matthieu Brunerie, it was clear that a change was needed. “When I arrived, there was no quality team at all. Deployments were done without testing, and we’d find issues only once they were live. That approach wasn’t sustainable.” Determined to instill a culture of robust quality assurance, he led a search for a better solution. After thorough research, the team landed on Tricentis Testim, drawn by its intuitive features and market-leading innovation – such as the recently released Testim Copilot, of which Brunerie’s team was an early adopter.

Testim quickly proved itself indispensable. The Smart Locator, a standout feature, enabled the tool to adapt to changes in the user interface, ensuring test stability even when elements on the page shifted. This feature uses AI to identify when properties in a user interface change and automatically update the associated test cases, eliminating the requirement to manually update test cases each time the application changes. Brunerie described testing the feature with enthusiasm: “We deliberately broke the page layout and moved buttons around, yet Testim still recognized the elements and ran the tests flawlessly. That level of robustness gave us confidence in our process.”

Testim Copilot tackles complex test scenarios

Beyond its technical capabilities, Testim streamlined workflows across the team. Test case creation times dropped from 15 minutes to under five and automation became more accessible to non-technical team members, thanks to Testim’s low-code test automation, and more recently, AI-powered test case generation using Testim Copilot. Le Livre Scolaire started using Testim Copilot when it was still in beta release. This tool empowered analysts with no prior coding experience to write and customize complex tests independently, freeing developers to focus on other priorities.

For Brunerie, the benefits were immediate. “We have analysts on the team who had never written a line of code in their lives, and now they’re creating automated tests entirely on their own,” he shared. The AI-powered Copilot interprets natural language inputs and converts them into sophisticated test actions, eliminating the need for deep programming knowledge. This newfound independence not only empowered the quality team but also reduced interruptions for developers, who could now focus on coding rather than supporting test creation. “It’s brought a sense of ownership and pride to the analysts,” Brunerie added.

“Our test analysts feel almost like developers now. They can create sophisticated tests without needing to involve the dev team. They feel more connected to the overall process, and the whole team is working more harmoniously as a result. It’s been a huge moral boost.”

Testim allows the team to be a lot more productive. With Testsigma, Brunerie’s team was forced to review an entire test case even if they wanted to change only one step to fulfill new requirements, a burden greatly alleviated by Testim’s Smart Locators. That made it difficult to stick to the biweekly release schedule. With Testim, work progresses much faster, and Brunerie is now thinking about moving to a weekly release schedule, so new features can be brought to the customers almost immediately. Brunerie reports that his team sees the majority of their test cases written by Testim Copilot are given the green light to go straight into production by the developers. The time saved is also used to have more interactions between the different teams; for instance, between developers, testers, and marketing, about new features that customers require.

Deploying with speed and confidence

The integration of Testim into Le Livre Scolaire’s CI/CD pipeline further enhanced their efficiency. With seamless connections to tools like GitHub and Jira, testing could be initiated at any time, anywhere. “I could launch a test from my phone right now if I wanted to,” Brunerie explained. The ability to deploy with confidence became a cornerstone of their quality assurance process, eliminating the anxiety that once surrounded production releases. Per release, Le Livre Scolaire has about 200 test cases. Many of these test cases are first run in an ephemeral environment before they move into the real test environment to test the application before new releases go into production. Tests run in parallel on 4 VMs to further boost the speed of the testing process, which now take 35 minutes each instead of over an hour while there are more tests created than before.

Using Testim is not only beneficial to the testing team; Le Livre Scolaire’s customers also benefit from an improved experience thanks to the integration between Applitools and Testim. “Developers are not always very demanding when it comes to the look and feel of a page. They care most about functionality. Testim uses Applitools to perform pixel-perfect visual/graphic non-regression tests on our web pages.”

Of course, no tool is perfect, but Tricentis’ customer support stood out for its responsiveness. When challenges surfaced, the team at Tricentis was quick to address them, providing fixes and updates in record time. For Matthieu Brunerie, this level of support was a welcome change from his previous experience: “With Testsigma, we often waited indefinitely for solutions. With Testim, our issues were resolved almost immediately.”

The results have been transformative. Le Livre Scolaire’s releases are now smoother, their tests more reliable, and their team more confident. Brunerie credits this shift not only to the technical capabilities of Testim but also to its user-centric design. “It’s one of the easiest tools to use. The interface is intuitive, and the documentation is spot on. Everything is built to help teams succeed.”

Looking ahead, Le Livre Scolaire plans to expand their use of Testim to include automated testing for their mobile applications, a growing area of their business. With teachers increasingly relying on tablets and mobile devices, ensuring consistent quality across platforms will be essential. Brunerie is optimistic about the future: “Testim has already revolutionized how we work. We’re excited to see how it can help us tackle new challenges as we grow.”

Results

  • 3X faster test case creation time, from 15 to under 5 minutes.
  • Using Testim Copilot makes complex test case creation easier, freeing up time for more strategic QA initiatives.
  • Seamless integration with tools such as GitHub and Jira enable test automation to be executed as part of the CI/CD process.
  • Parallel test execution across 4 VMs significantly reduces test execution time and accelerates the path to release.