SPR recently presented a Testing Leadership Workshop at Chicago’s Willis Tower. The solution-packed afternoon drew testing leaders and practitioners from companies including CDW, Northern Trust, and Paylocity. SPR’s Nancy Kastl, Practice Director of Testing Services, and Joey Figliulo, Testing Sales Specialist, hosted the event, joined by facilitators Dai Whaley, VP of Quality Engineering at Applied Systems; Ryan Burlage, Solution Architect at Tricentis; and Matt Mead, CTO at SPR.
Automation a Top Priority
The workshop was designed to allow participants to identify their challenges in software testing and for group discussion of potential solutions based on experiences. Nancy and the SPR team sent a survey prior to the workshop to gather the participants’ most pressing testing challenges, and found that test automation and resources were among the top challenges. Automation was the theme throughout the workshop activities. An informal poll of attendees showed that around 90% were doing some form of test automation. During two workshop activities, attendees captured issues with automation on sticky notes and stuck the notes to the event room’s walls. Broken into teams, attendees reviewed their challenges, identified duplicates, grouped similar challenges, and then selected their top two automation challenges. Several common challenges arose. Top challenges our attendees are facing include: automation resources and skills, whole team ownership of automation, test script resiliency and test coverage, automation tools, data creation and management, and in-sprint automation.
Challenge 1: How Test Data is Handled
Challenges abound with data. Data can be sensitive and must be handled appropriately, and identifying and obfuscating sensitive data can be difficult and time consuming. In many cases, only a few people understand the data and it can be hard to determine which data is the right data. Waiting for proper data can take weeks, and masking and stripping PII from sensitive data can add to that timing.
The attendees then brainstormed solutions, and one solution rose to the top: data governance. Setting rules who can touch which data, data segregation, appropriately reverting data at the end of an automated test, and data assignment or reservation can help make test automation run more smoothly. Attendees agreed that a mindset shift is critical, and that upskilling and training are often necessary.
Challenge 2: Getting the Whole Team to Own Automation
Automation faces even greater challenges when only Quality professionals own automation. Attendees highlighted struggles with lack of up-to-date documentation, lack of ownership around application and code quality, and lack of well-defined acceptance criteria for releasing a new build to QA or production.
One resounding challenge we heard again and again was time. The race against the sprint cycle makes achieving quality software difficult, with quality often sacrificed to achieve a greater speed to market.
When brainstorming solutions, it became clear that team building and leadership were essential in tackling this challenge. A top-down quality culture and mindset is critical to holding all parties accountable for quality, while bottom-up team building can foster a shared ownership of quality and greater respect between team members. Getting developers and testers to tackle problems together can go a long way. Setting metrics and goals can also drive accountability and entrench quality in the team culture.
New Solutions, New Connections
Throughout the afternoon, testing professionals engaged with each other, working together to solve the common problems most are facing. Not only did the attendees leave with inspiration and solutions to try, they also left with new connections within their profession, enabling them to continue the dialogue long beyond our testing leadership event.