University of Illinois Urbana-Champaign

Machine learning approaches to improving mispronunciation detection on an imbalanced corpus

Yang, Xuesong

Content Files
YANG-THESIS-2015.pdf

Permalink

https://hdl.handle.net/2142/89050

Description

Title
Machine learning approaches to improving mispronunciation detection on an imbalanced corpus
Author(s)
Yang, Xuesong
Issue Date
2015-12-07
Director of Research (if dissertation) or Advisor (if thesis)
Hasegawa-Johnson, Mark A.
Department of Study
Electrical & Computer Engineering
Discipline
Electrical & Computer Engineering
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2016-03-02T19:34:21Z
Keyword(s)
  • Imbalanced Learning
  • Sampling Methods
  • Pronunciation Error Detection
  • Spoken Language Assessment
  • Computer Assisted Language Learning
Abstract
This thesis reports the investigations into the task of phone-level pronunciation error detection, the performance of which is heavily affected by the imbalanced distribution of the classes in a manually annotated data set of non-native English (Read Aloud responses from the TOEFL Junior Pilot assessment). In order to address problems caused by this extreme class imbalance, two machine learning approaches, cost-sensitive learning and over-sampling, are explored to improve the classification performance. Specifically, approaches which assigned weights inversely proportional to class frequencies and synthetic minority over-sampling technique (SMOTE) were applied to a range of classifiers using feature sets that included information about the acoustic signal, the linguistic properties of the utterance, and word identity. Empirical experiments demonstrate that both balancing approaches lead to a substantial performance improvement (in terms of f1 score) over the baseline on this extremely imbalanced data set. In addition, this thesis also discusses which features are the most important and which classifiers are most effective for the task of identifying phone-level pronunciation errors in non-native speech.
Graduation Semester
2015-12
Type of Resource
text
Permalink
http://hdl.handle.net/2142/89050
Copyright and License Information
Copyright 2015 Xuesong Yang

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Electrical and Computer Engineering
Dissertations and Theses in Electrical and Computer Engineering