Identifying and Classifying Aberrant Response Patterns Through Functional Data Analysis

Eduardo Doval, Pedro Delicado

Research output: Contribution to journalArticleResearchpeer-review

Abstract

We propose new methods for identifying and classifying aberrant response patterns (ARPs) by means of functional data analysis. These methods take the person response function (PRF) of an individual and compare it with the pattern that would correspond to a generic individual of the same ability according to the item-person response surface. ARPs correspond to atypical difference functions. The ARP classification is done with functional data clustering applied to the PRFs identified as ARP. We apply these methods to two sets of simulated data (the first is used to illustrate the ARP identification methods and the second demonstrates classification of the response patterns flagged as ARP) and a real data set (a Grade 12 science assessment test, SAT, with 32 items answered by 600 examinees). For comparative purposes, ARPs are also identified with three nonparametric person-fit indices (Ht, Modified Caution Index, and ZU3). Our results indicate that the ARP detection ability of one of our proposed methods is comparable to that of person-fit indices. Moreover, the proposed classification methods enable ARP associated with either spuriously low or spuriously high scores to be distinguished.

Original languageEnglish
Pages (from-to)719-749
Number of pages31
JournalJournal of Educational and Behavioral Statistics
Volume45
Issue number6
DOIs
Publication statusPublished - 1 Dec 2020

Keywords

  • functional clustering
  • functional data analysis
  • item-person response surface
  • outlier detection
  • person response function
  • person-fit

Fingerprint Dive into the research topics of 'Identifying and Classifying Aberrant Response Patterns Through Functional Data Analysis'. Together they form a unique fingerprint.

Cite this