Prove It Podcast #3

How do you know your training worked?

Using assessment data to measure learning impact

Your learners finished on time and the pass rate looks great. That tells you who turned up and got through. It doesn’t tell you whether they can do the work any better than before. In this episode Robbie Burns talks to Gary Allison, Director of Learning Applications at Spiirall by LCvista, about what assessment data can show that completion figures can’t. For Gary the pass rate is where the work starts. Every result, good or bad, sends him looking for the next question and the next intervention.

Watch the episode

What we cover

What "learning impact" actually means

For Gary it comes down to what people can do after a programme that they couldn’t do before, whether that’s faster, more accurately or at all. Different objectives need different evidence, so the starting point is always knowing what you’re trying to change.

When compliance becomes the strategy

Pass rates, completions and hours are easy to capture, so they end up as the measure. If learners are told they need a certain number of credits, they chase credits. Gary argues that a learning strategy meets compliance easily, while a compliance strategy rarely produces real learning.

Building evidence in stages

Did they learn it, do they remember it, and does it show up in their work? Gary explains how pre- and post-assessments, retention check-ins and on-the-job observation build a picture over time. He’s after valid measures rather than perfect ones, and he never claims more than the design supports.

Five questions for your next results review

Assessment data should do more than report what happened. It should help you decide what happens next. Robbie closes with five questions to take back to your own organisation, starting with where learners consistently struggled.

Download this episode's resources and learn when new episodes are out

Five questions to ask when the pass rate looks good
Find the topics a high pass rate hides, the learners who only just scraped through and the one change that will make the biggest difference next time.

Meet the experts

Robbie Burns
Head of Business Consulting, Cirrus Assessment
Leads Cirrus’s consulting and managed services team, with 25+ years modernising high-stakes assessment — from paper to digital, local to global.
Gary Allison
Director of Learning Applications, Spiirall by LCvista
Gary works across learning strategy, instructional design, assessment and measuring the impact of learning, with a background in both higher education and corporate learning.

More episodes

Coming soon
Episode #2

The Wrong Question?

Why AI is forcing us to rethink assessment
AI didn't break assessment. It exposed weaknesses that were already there. Psychometrician Paula Baetu on why the real fix isn't stopping cheating, it's collecting better evidence.
Coming soon
Episode #1

What are we really measuring?

Rethinking fairness in assessment design
Are consistency and fairness the same thing? It’s one of the field’s most common assumptions, and this session challenges it head on.

Know exactly where your assessment operation stands

Your free personalised report in 4 minutes

Answer 12 questions across strategy, delivery, design and data and get a clear, personalised breakdown of where your assessment operation is strong and where to focus next.