Prove It Podcast #1

What are we really measuring?

Rethinking fairness in assessment design

Most assessment processes are built around an ideal candidate. Someone who is calm, confident, digitally fluent, familiar with the process and operating in controlled conditions. But that candidate is a fiction, and designing around them has consequences. This session challenges one of the most deeply embedded assumptions in assessment: that consistency and fairness are the same thing. They are not.

Watch the episode

What we cover

The ideal candidate

Most assessments are designed around a candidate who doesn’t really exist. We look at what that costs you.

Reliability vs validity

Why consistent delivery does not guarantee valid measurement.

Accessibility as a validity issue

When a barrier has nothing to do with the capability you are measuring, it changes what the assessment is actually testing.

Legitimate vs accidental difficulty

Some difficulty belongs in your assessment. Some has just always been there. Knowing the difference is the starting point.

The Three Layers of Assessment Fairness handout preview

Download this episode's resources and learn when new episodes are out

The Three Layers of Assessment Fairness
a framework for thinking about access, validity and candidate experience.

Four design questions
to help your team put the framework to work immediately.

Meet the experts

Robbie Burns
Head of Business Consulting, Cirrus Assessment
Leads Cirrus’s consulting and managed services team, with 25+ years modernising high-stakes assessment — from paper to digital, local to global.
Cristina Gilbert
Cristina Gilbert
Strategic Partnerships, Cirrus Assessment
Cristina leads strategic partnerships at Cirrus Assessment, building the relationships that help assessment evolve.
Hugh McNeela
Hugh McNeela
ReadSpeaker
Brings six years in SaaS and tech, with a passion for making education more inclusive and accessible.

More episodes

Coming soon
Episode #2

The Wrong Question?

Why AI is forcing us to rethink assessment
AI didn't break assessment. It exposed weaknesses that were already there. Psychometrician Paula Baetu on why the real fix isn't stopping cheating, it's collecting better evidence.
Coming soon
Episode #3

If your data isn’t changing decisions, what’s the point of collecting it?

Why collecting data is easy and acting on it is hard.
Testing organisations collect enormous amounts of data. But how much of it actually improves assessment quality, candidate experience or decision-making?

Know exactly where your assessment operation stands

Your free personalised report in 4 minutes

Answer 12 questions across strategy, delivery, design and data and get a clear, personalised breakdown of where your assessment operation is strong and where to focus next.