Webinar recap: Rethinking Test Security

Share via:

How can we prevent cheating and content leakage in high-stakes exams? And achieve up to 90% saving on the exam delivery costs?

Find a recap of our latest webinar below or register to watch the webinar in full

Welcome to our new webinar series on e-assessment trends. Today’s topic is test security, and we will be discussing an innovative solution to prevent cheating and content leakage in high-stakes exams while saving up to 90% on exam delivery costs  – through a revolutionary method called LOFT 3.0. 

LOFT 3.0 ensures that every exam form contains a unique set of questions that is psychometrically balanced in terms of difficulty and fairness. Cirrus’ founder and CEO, Vegard Sivertsen, presents the truly limitless potential of this technology.  

There are two primary challenges faced by the high-stakes e-assessment market today: cheating prevention and content leakage. Content theft leads to significant costs for organisations as they need to recreate their exams. If a test form is leaked, the exam organisation has to create a new exam, which may cost up to €450,000. 

Currently, to prevent content theft, 90% of high-stakes exams are conducted in large scale test centres. This is inflexible for both testing organisations and test-takers and expensive, as delivering exams in test centres can cost up to €70 per test per candidate. 

However, LOFT 3.0 provides an efficient solution to minimise cheating and content theft while saving up to 90% on exam delivery costs and implementing LOFT 3.0 is relatively straightforward: 

  1. The first step is to develop your item bank and ensure that each item is well-tagged with metadata, such as topic, type of knowledge and difficulty level. 
  2. Second, you’ll want to ensure that the questions are tagged according to friend and enemy relationships. This prevents some questions from giving away answers to other questions (enemies) or not making sense if they are not asked as part of a group of questions (friends). 
  3. The third step is to configure your exam blueprint. Here you select the number of questions per topic, difficulty, type of knowledge measured, etc. It ensures that each generated exam is valid and tests what is supposed to be tested. . 
  4. As a result, when candidates start the exam, they will each get a random, unique test form with questions from the item banks according to the blueprint. More importantly, each exam will be psychometrically balanced.

To ensure that exams are psychometrically balanced and defensible in the court of law, it is essential to calibrate the item bank and make sure that the psychometric data is in the system. The system then generates balanced assessment forms, so that candidates do not get only difficult or easy questions.

To take advantage of LOFT 3.0, you’ll need a platform that supports psychometrically balanced Blueprints and LOFT exam delivery. You’d also need subject matter experts who can easily collaborate on your e-assessment platform to set up the blueprint and item bank. Keen to get started? We’d love to show you how Cirrus can help you deliver unique, on-demand exams and minimise content theft and cheating. Book a demo to find out more.

Share via:
Topics
Would you like to receive Cirrus news directly in your inbox?
More posts in Better Assessments
Better Assessments

Choosing the Right Proctoring Model for Your Assessment

Everyone wants to know the best way to proctor an exam. There isn’t one. Every qualification carries its own purpose, stakes, candidates and constraints, so the useful question is not which model is best, but which model fits, and whether you can explain why you chose it.

Read More »
Better Assessments

How Secure Is Secure Enough?

There is no universal definition of secure enough. The answer depends on what the task exposes, what is at stake if the result is wrong, and the scale you are working at. The third article in The Proctoring Question sets out how to match the control to the risk, and what it costs when you get it wrong.

Read More »

Know exactly where your assessment operation stands

Your free personalised report in 4 minutes

Answer 12 questions across strategy, delivery, design and data and get a clear, personalised breakdown of where your assessment operation is strong and where to focus next.