University of Illinois Urbana-Champaign

Deconstructing a domain into its cognitive attributes: test construction and data analysis

Patterson, Julie A.

Content Files
Patterson_Julie.pdf

Permalink

https://hdl.handle.net/2142/26083

Description

Title
Deconstructing a domain into its cognitive attributes: test construction and data analysis
Author(s)
Patterson, Julie A.
Issue Date
2011-08-25T22:12:20Z
Director of Research (if dissertation) or Advisor (if thesis)
Douglas, Jeffrey A.
Doctoral Committee Chair(s)
Douglas, Jeffrey
Committee Member(s)
  • Stout, William F.
  • Chang, Hua-Hua
  • Anderson, Carolyn J.
Department of Study
Educational Psychology
Discipline
Educational Psychology
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Date of Ingest
2011-08-25T22:12:20Z
Keyword(s)
  • cognitive diagnosis models
  • big ideas
  • Fusion Model
  • statistics assessment
Abstract
If a cognitive model of learning provides the framework for both the educational system (i.e., curriculum, instruction, and assessment) and the design of the assessment, then both learning and instruction are optimized (Huff & Goodman, 2007). In this paper I describe the process of creating a cognitive framework for a college-level introductory statistics course. I begin with a review the current literature relating to cognitive diagnosis assessments and cognitive diagnosis models. Then I explain the procedure of deconstructing the course domain into a hierarchical arrangement of cognitive attributes and I explain the process of constructing a 50-item multiple-choice assessment that will be used to determine examinee mastery of the attributes. For the analysis of the examination data, I will present the item parameter estimates, examinee parameter estimates, and model fit statistics that were found using Item Response Theory, the Continuous Diagnostic Model, and the Fusion Model. Finally, I will discuss the compare examinee classification rates for simulated examination data that were found using a reduced version of the Option Based Fusion Model (which uses information from distractors or incorrect options) and the original Fusion Model. The results of the simulation study indicate that information is gained by using specific answer choices in the cognitive model.
Graduation Semester
2011-08
Permalink
http://hdl.handle.net/2142/26083
Copyright and License Information
Copyright 2011 Julie Ann Patterson

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Education
Dissertations and Theses from the College of Education