What Engineering Leaders Often Misunderstand About Testing

Testing is not merely execution work. At senior levels, testing is applied systems thinking: risk analysis, evidence design, feedback economics, user advocacy, and technical diagnosis.

What leaders often miss

Some engineering leaders understand testing deeply. Others still see it as a downstream activity that validates finished work. That misunderstanding limits the value they get from QA and often leads to poor decisions about staffing, automation, metrics, and release readiness.

If testing is seen as execution, the organization optimizes for throughput of test cases. If testing is seen as risk intelligence, the organization optimizes for better decisions. The difference is significant. Execution finds some defects. Risk intelligence improves how software is built.

A few external anchors

DORA connects high performance with human factors, user-centricity, stable priorities, and continuous improvement. Google SRE's SLO model shows that technical teams need carefully chosen indicators of user-relevant behavior. Testing at senior levels operates in the same decision space.

The message I would give engineering leaders

Testing is not a phase. It is a way of interrogating a system before, during, and after change.

Good testers do not merely check expected behavior. They ask what assumptions the system depends on, where ambiguity hides, what failure would hurt, and how evidence can be gathered efficiently.

Automation does not replace this judgment. It encodes some parts of it. The hard work is deciding what evidence matters and how much confidence is enough.

Five Questions Leaders Should Ask QA

  • Which risks are we most concerned about and why?
  • Which evidence gives us confidence, and which evidence is weak or missing?
  • Where is the product or architecture making testing harder than it should be?
  • What would we need to detect and recover if this fails in production?
  • What should change upstream so this category of risk appears less often?

A metrics example

A leader asking 'How many test cases are left?' gets schedule information. A leader asking 'What risks remain uncovered?' gets decision information. The second question changes the conversation from task tracking to release judgment.

Leadership blind spots

  • Equating automation percentage with quality maturity.
  • Assuming late QA involvement saves time because testers are used only when code is ready.
  • Underinvesting in testability, observability, and data management while expecting faster testing.

What credible QA leadership brings

  • Invite QA into design reviews for high-risk changes.
  • Measure quality conversations by decisions improved, not just defects found.
  • Fund engineering work that reduces test friction and improves signal quality.

Testing is one of the few disciplines that deliberately studies how software might be wrong. Leaders who understand that use QA as a strategic capability, not a downstream service.

Sources worth reading