Development and Field Testing of Behaviorally Anchored Rating Scales for Evaluating Performance in Clinical Dietetics
Novascone, Mary Ann
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/68832
Description
Title
Development and Field Testing of Behaviorally Anchored Rating Scales for Evaluating Performance in Clinical Dietetics
Author(s)
Novascone, Mary Ann
Issue Date
1982
Department of Study
Education
Discipline
Education
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
Education, Health
Abstract
The focus of this research was on the development and field testing of a set of behaviorally anchored rating scales (BARS) for evaluating the performance of dietetic students. The unique feature of the instrument developed in this study (D/BARS) was that it was designed specifically for use in (1) the clinical component of Co-ordinated Undergraduate Programs (CUPs) and internships offering a medical dietetics specialty and (2) the clinical component of generalist CUPs and internships when the medical dietetics aspect of the curriculum constituted the content area of the clinical rotation.
A variation of the Smith-Kendall technique was used to develop the D/BARS. This variation included three interrelated phases: development and refinement of the dimension statements, development of the behavioral anchors, and a retranslation process. The D/BARS were field tested in sixteen clinical rotations within eight dietetic education programs. Evaluators not only rated student performance using the D/BARS but also commented on the adequacy of the dimension statements and the appropriateness of the D/BARS for formative and summative evaluation.
In general, the mid-to-upper portions of the scales were used most frequently, and little score variation either within or across programs was present. The dimension statements were found to represent essential aspects of the practice of dietetics, and the scales were deemed appropriate for formative evaluation. However, some evaluators who had to assign a grade to students' performance were uncomfortable with some of the anchor statements. When the D/BARS were field tested in a dietetic work setting, the chief dietitian found all scales to be appropriate for evaluating staff dietitians.
The results of the field tests suggest a need for the revision of the behavioral anchors. This could be accomplished through a more extensive retranslation process with the possibility of the revised scales being generalizable across more dietetic education programs. Since the process used to develop the D/BARS fostered the articulation of performance criteria, it is recommended as a practical approach for addressing the issue of setting performance standards.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
