QA Metrics

4 categories metrics

• Process metrics — efficiency.
• Product quality — output quality.
• Test effectiveness — test catching bugs.
• Team health — sustainability.

Process metrics

• Test case execution rate.
• Automation %.
• Cycle time (commit → production).
• Test environment uptime.

Product quality

• Defect Escape Rate — bugs found in prod / total bugs found.
• Defect Density — bugs / KLOC or per feature.
• Severity distribution — % critical, high, medium, low.
• MTTR (Mean Time To Resolve).

Test effectiveness

• Test Pass Rate — % tests passing.
• Defect Detection Effectiveness — bugs found by QA / (bugs found by QA + bugs escaped to prod).
• Test Coverage — code coverage + requirement coverage.

Team health

• QA NPS internal.
• Test suite stability (flaky rate).
• On-call rotation balance.
• Time spent on automation vs manual.

Anti-pattern KPI

• Bug count target — incentivize quantity over quality.
• Test case count — incentivize bloat.
• % automation alone — automate trivial test, miss high-value test.

Best practice

• Track 3-5 metrics top, not 30.
• Lead indicators (early signal) + lag indicators (outcome).
• Trend > absolute number.

VN team common KPI

• Escape rate < 5% trong quarter.
• Critical bug 0 in production.
• Automation > 60% regression.