Perspectives of Deaf and Hard-of-Hearing Viewers on Live-TV Caption Quality

Amin, Akhter A.; Huenerfauth, Matt

Permalink

https://hdl.handle.net/2142/109692 Copy

Description

Title

Perspectives of Deaf and Hard-of-Hearing Viewers on Live-TV Caption Quality

Author(s)

• Amin, Akhter A.
• Huenerfauth, Matt

Issue Date

2021-03-17

Keyword(s)

• Caption
• Metric
• Evaluation

Abstract

While the availability of captioned television programming has increased, the quality of captioning service is not always acceptable to Deaf and Hard of Hearing (DHH) viewers, especially for live or unscripted content, broadcast from local television stations. There is a need for formal metrics to evaluate captioning quality, to enable audits or quality assurance. Although some current caption-evaluation metrics focus on evaluating the textual accuracy (comparing the caption text and accurate transcription of what was spoken), there are other properties of captions that may influence the quality or usability judgments of DHH users. In this work-in-progress, we are conducting experiments with DHH participants to evaluate videos with various levels of caption quality, to learn which features correlate to user judgments. These studies will also yield a valuable dataset of videos with accompanying quality-judgments by DHH participants, which will be used to evaluate potential metrics we will design and evaluate.

Publisher

iSchools

Type of Resource

text

Language

eng

Permalink

http://hdl.handle.net/2142/109692

Sponsor(s)/Grant Number(s)

the Department of Health and Human Services

Copyright and License Information

Copyright 2021 is held by Akhter A. Amin and Matt Huenerfauth. Copyright permissions, when appropriate, must be obtained directly from the authors.

Owning Collections