University of Illinois Urbana-Champaign

An intelligent tool for annotating collections of written feedback

Schoening, Mia Johanna

Content Files
SCHOENING-THESIS-2020.pdf

Permalink

https://hdl.handle.net/2142/108634

Description

Title
An intelligent tool for annotating collections of written feedback
Author(s)
Schoening, Mia Johanna
Issue Date
2020-07-21
Director of Research (if dissertation) or Advisor (if thesis)
Bailey, Brian P
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2020-10-07T22:44:42Z
Keyword(s)
  • Content Annotation
  • Feedback
  • Intelligent Assistance
Abstract
Online content annotation tools have become increasingly popular as more and more content is being presented in a digital, written format. Yet such tools are still needed in the domain of creative feedback, where annotation is critical in helping users to effectively interpret feedback and make quality revisions. We therefore present a novel content annotation tool (CATIA) aimed at supporting users in annotating collections of written feedback through categorization. Because the process of categorizing feedback is one that is often tedious and time-consuming, our tool integrates intelligent assistance in the form of recommendations, to further assist people as they annotate feedback documents. Through a small study (N = 4) evaluating CATIA against a baseline tool without intelligent assistance, we found that all participants preferred the use of CATIA to complete feedback categorization tasks. The recommendations were shown to be effective at clustering similar statements within a feedback document, thereby reducing the frequency with which users must switch focus between categories. Participants thus responded positively to the integration of the intelligent assistance, crediting the recommendations with making the annotation process easier and less overwhelming overall.
Graduation Semester
2020-08
Type of Resource
Thesis
Permalink
http://hdl.handle.net/2142/108634
Copyright and License Information
Copyright 2020 Mia Schoening

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Computer Science
Dissertations and Theses from the Siebel School of Computer Science