A qualification is only as good as its design. Ofqual’s rules ask Awarding Organisations to ensure each qualification is fit for the purposes for which it is intended — and to keep that fitness under review across its life. The technical concepts behind this aren’t box-ticking exercises; they are the design principles that make a qualification defensible. This article explains the core ones and how to build them in from the start.
Start with purpose
Every robust qualification begins with a clear statement of what it is for, who it is for, and what a successful learner can do at the end. Purpose is the anchor: assessment design, level, and content all flow from it. When the original purpose or design needs to change over time, that anchor is also what tells you whether the qualification still holds together.
The concepts that make a qualification sound
Validity
Validity is the extent to which evidence and theory support the interpretation that the assessment outcomes meet their intended uses. In plainer terms: does the assessment actually measure what it claims to, in a way that supports the decisions made on the back of it? Validity is the headline property — most other design choices serve it.
Reliability
Reliability is about consistency. Would a learner achieve a comparable outcome on a different day, with a different marker, or on a different version of the assessment? Unreliable assessment undermines trust in the result, however well-intentioned the design.
Comparability
Outcomes from different forms of the same assessment must be comparable if they are to measure standards over time. Both expert judgement and statistical procedures such as test equating are used to keep different versions in line. Comparability is what lets a grade mean the same thing this year as last.
Manageability and minimising bias
A qualification also has to be practical to deliver, and fair. Manageability keeps assessment workable for centres and learners; minimising bias ensures no group is unfairly advantaged or disadvantaged by design choices that have nothing to do with the competence being measured.
Grading deserves particular care. An Awarding Organisation must set out the technical methodology for determining grade boundaries, and justify how it sets and maintains grading standards — both over time and against similar qualifications it offers.
Designing it in from day one
- Write the purpose statement first, and keep returning to it. Every later decision should be traceable back to it.
- Map learning outcomes to assessment. Each outcome should be assessed in a way that genuinely evidences it — that is validity in practice.
- Plan for multiple forms early. If you will ever need more than one version, build comparability into the assessment model from the outset rather than retrofitting it.
- Document your grading methodology. Be able to explain, in technical terms, how boundaries are set and standards maintained.
- Build in review. Fitness for purpose is not a one-time judgement; schedule the points at which you will re-examine it.
The bottom line
Validity, reliability and comparability are not regulatory hoops — they are the qualities that make a qualification trustworthy. Bridge the gap between educational intent and regulatory requirement at the design stage, and compliance becomes a consequence of good design rather than a separate burden.
This article is general guidance, not regulatory or legal advice. Requirements change; always check the current Ofqual Handbook and Criteria for Recognition on GOV.UK, and take advice on your specific circumstances.