A multidimensional approach for analyzing variants of code writing questions in a CS1 course
Butler, Liia M.
Loading…
Permalink
https://hdl.handle.net/2142/105071
Description
Title
A multidimensional approach for analyzing variants of code writing questions in a CS1 course
Author(s)
Butler, Liia M.
Issue Date
2019-04-22
Director of Research (if dissertation) or Advisor (if thesis)
Xie, Tao
Challen, Geoffrey
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
Question Variants
CS1
code writing
exam questions
assessment
Abstract
To defend against collaborative cheating in code writing questions, instructors of CS1 courses with asynchronous exams can use the strategy of question variants, being manually written questions to be selected at random to assess the same learning goal. In order to create these variants, currently the instructors have to rely on intuition to accomplish the competing goals of ensuring variants are different enough to defend against collaborative cheating, and yet similar enough where students are assessed fairly. In this paper, we propose a multidimensional approach of analyzing these variants. We apply our approach on a dataset of 3 midterm exams from a large CS1 course. Our results show that (1) observable inequalities exist between variants and (2) these differences are not just limited to score. Our results also show that the information gathered from our analysis approach can be used to provide recommendations for improving design of future variants.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
