How to Build a 12-Month QA Improvement Roadmap

Most QA leaders try to fix an organization before they have honestly measured it. If you want to build a 12-month QA improvement roadmap that leadership actually funds, this is for you. Early in my career I thought testing assessments were unnecessary, because I felt I already had a good command of what my team needed to do. Over time I became a strong believer in them, especially when an outside entity runs the assessment. The video above explains why, and below is the written version of how an assessment turns into a roadmap, from the maturity model to the interviews to the executive readout that drives real change.

What a QA assessment actually measures

An assessment rates your testing maturity across processes, automation, and environments, usually on a one-to-five scale.

An assessment often leans on a maturity model such as TMMi, which ranks conditions like process discipline, automation, performance testing, environment management, and the code deployment path. The scale runs from level one to level five.

Unless you are doing life-critical work or launching rockets, you rarely need level five. I explain this in the video. In most organizations, a level three is enough to get you what you need, and pushing to four or five costs far more time and energy than the return justifies.

Why an independent assessor matters

An outside entity strips out the internal bias you cannot see in your own organization.

Here is the part I underrated for years. If it is my own QA organization, I have already formed my opinion about what is good and what is not. That bias is almost impossible to remove from the inside.

An independent person, ideally one who has not worked in your organization before, sees it clean. What I learned is that the outside view is not just more objective, it is more persuasive to leadership, which is exactly what you need to fund the roadmap that follows.

The interview process

You interview inside QA, the surrounding teams, and leadership to build a full picture of where quality really stands.

An assessment runs on interviews. I talk to people inside the QA organization, but also to development and the business, because their perception of what QA does well and poorly is data. I interview leadership across those groups to capture their expectations.

I ask what is working well, what needs to improve, and, more recently, the one thing they would change if they could change anything. That last question surfaces the most useful answers. Then I go deeper into specific processes: how automation gets initiated end to end, and what the stage gates of quality look like from requirements through test plans, execution, and defect capture.

From findings to a roadmap

You compile the interviews into an executive readout, then turn the improvement items into a phased 12-month roadmap.

I record and save each transcript, and I have been leveraging AI to compile them faster. I build a detailed document per interview, roll it into one master document, and turn that into a PowerPoint I walk through with executives. The readout covers what is working, but the value is in the improvement items.

Those improvement items become the roadmap. You can phase them over 12 months or stretch to three years, with checkpoints after year one and year two to see whether maturity actually moved. I found that the roadmap lands harder when an outside entity backs it, because leadership hears the same recommendations from an independent source and gives them credibility internal voices rarely get on their own.

The takeaway

A 12-month QA improvement roadmap is only as good as the assessment underneath it. Measure maturity honestly with a model like TMMi, aim for a realistic level rather than a perfect one, and bring in an independent assessor to strip out internal bias and add credibility with leadership. Run structured interviews across QA, development, the business, and leadership, compile the findings into an executive readout, and convert the improvement items into a phased roadmap with checkpoints. That is how you move from opinion to a plan the organization will fund.

Watch the full walkthrough in my video on building a QA improvement roadmap, and I cover the assessment interview questions in the video. I also explain the value of an independent assessor in the video. Here is my question for the comments: has your QA organization ever been through a formal assessment, and what did it change? Subscribe for more on QA strategy.