Multiple maximum exposure rates in computerized adaptive testing

Juan Ramón Barrada, Bernard P. Veldkamp, Julio Olea

Research output: Contribution to journalArticleResearchpeer-review

10 Citations (Scopus)

Abstract

Computerized adaptive testing is subject to security problems, as the item bank content remains operative over long periods and administration time is flexible for examinees. Spreading the content of a part of the item bank could lead to an overestimation of the examinees' trait level. The most common way of reducing this risk is to impose a maximum exposure rate (r max) that no item should exceed. Several methods have been proposed with this aim. All of these methods establish a single value of r max throughout the test. This study presents a new method, the multiple-r max method, that defines as many values of r max as the number of items presented in the test. In this way, it is possible to impose a high degree of randomness in item selection at the beginning of the test, leaving the administration of items with the best psychometric properties to the moment when the trait level estimation is most accurate. The implementation of the multiple-r max method is described and is tested in simulated item banks and in an operative bank. Compared with a single maximum exposure method, the new method has a more balanced usage of the item bank and delays the possible distortion of trait estimation due to security problems, with either no or only slight decrements of measurement accuracy. © 2009 Sage Publications.
Original languageEnglish
Pages (from-to)58-73
JournalApplied Psychological Measurement
Volume33
Issue number1
DOIs
Publication statusPublished - 1 Jan 2009

Keywords

  • Computerized adaptive testing
  • Item exposure control
  • Item selection
  • Test security

Fingerprint Dive into the research topics of 'Multiple maximum exposure rates in computerized adaptive testing'. Together they form a unique fingerprint.

Cite this