Controlling item exposure for response time-informed item selection in computerized adaptive testing
Choe, Edison
Loading…
Permalink
https://hdl.handle.net/2142/49591
Description
Title
Controlling item exposure for response time-informed item selection in computerized adaptive testing
Author(s)
Choe, Edison
Issue Date
2014-05-30T16:51:26Z
Director of Research (if dissertation) or Advisor (if thesis)
Chang, Hua-Hua
Department of Study
Psychology
Discipline
Psychology
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.A.
Degree Level
Thesis
Keyword(s)
item exposure
item selection
response time
computerized adaptive testing (CAT)
Abstract
Fan et al. (2012) demonstrated that inversely weighting the maximum information criterion (MIC) by the expected response time for each item effectively reduced the average completion time for a test of fixed length while maintaining efficiency of ability estimation. However, this also resulted in an extremely skewed distribution of item exposure rates. To counter this issue, they recommended the use of the a-stratification with b-blocking (ASB) method, which balanced item exposure very well but at the cost of compromising on the average test time reduction and increasing the error of ability estimation. Therefore, the current study investigated several alternative methods for item exposure control when using response time-informed MIC, of which the most promising technique was inversely weighting MIC by the expected response time centered around 1.3. Simulation results showed that this simple modification markedly improved performance over employing ASB when utilizing response time information for item selection in computerized adaptive testing (CAT).
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
