The effect of specificity of language test specifications on item construction
Cho, Dongwan
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/21983
Description
Title
The effect of specificity of language test specifications on item construction
Author(s)
Cho, Dongwan
Issue Date
1995
Doctoral Committee Chair(s)
McClure, Erica F.
Department of Study
Education
Discipline
Education
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
Education, Language and Literature
Education, Tests and Measurements
Language
eng
Abstract
In criterion-referenced testing, test specifications presenting the explicit guidelines for the construction of test items have been regarded as a significant tool for securing content validity of the test. It is because the requirements or conditions for the development of test items stated in test specifications are believed to help construct the homogenous items originally intended, delimiting the scope of test items. The dilemma of this item construction method lies in the high degree of explicitness: The item writer is likely to ignore the detailed description of test specifications due to practical reasons such as lack of time and/or expense. Keeping these concerns in mind, this research aims to investigate the effect of the explicitness of language test specifications on item construction.
For the purposes of this study, three test specifications for an ESL reading comprehension test differing in their degree of explicitness were developed. On the basis of these three test specifications, nine item writers developed 54 items. A test consisting of 15 items chosen out of the 54 was administered to 527 ESL students.
The 54 items developed were examined by three judges with respect to the quality of items. The assessment of the judges showed that the items developed on the basis of less explicit test specifications were better than those using more explicit test specifications. The statistical analysis of the test using classical test theory, item response theory, and distracter analysis, however, showed somewhat different results in that the more explicit test specifications were better than the less explicit ones in the construction of correct response and distracters.
The results of this study led us to make the following suggestions: (a) test specifications do not have to be as explicit as they could be, (b) the construction of test specifications should reflect the item writer's opinions and difficulties, and (c) test development should be an ongoing process. In order to implement the aforementioned suggestions, more research oriented towards qualitative and longitudinal paradigms, which is expected to reveal test development processes, should be conducted in the language testing field.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
