Structured prediction with indirect supervision

Chang, Ming-Wei

Permalink

https://hdl.handle.net/2142/29768 Copy

Description

Title

Structured prediction with indirect supervision

Author(s)

Chang, Ming-Wei

Issue Date

2012-02-06T20:15:19Z

Director of Research (if dissertation) or Advisor (if thesis)

Roth, Dan

Doctoral Committee Chair(s)

Roth, Dan

Committee Member(s)

• DeJong, Gerald F.
• Hoiem, Derek W.
• Smith, Noah

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Machine learning
• natural language processing
• structural learning
• indirect supervision
• constraint driven learning

Abstract

Structured tasks, which often involve many interdependent decisions for each example, are the backbone for many important applications such as natural language processing tasks. The models built for structured tasks need to be capable of assigning values to a set of interdependent variables. In this thesis, we point out that the strong dependencies between the decisions in structured tasks can be exploited to simplify both the learning task and the annotation effort --- it is sometimes possible to supply partial and indirect supervision to only some of the target variables or to other variables that are derivatives of the target variables and thus reduce the supervision effort significantly. Based on this intuition, this thesis addresses the problem of reducing the cost of labeling for structural tasks. We tackle this problem by developing advanced machine learning algorithms that can learn and generalize from indirect supervision in addition to labeled data. Indirect supervision can come in the form of constraints or weaker supervision signals. Our proposed learning frameworks can handle both structured output problems and problems with latent structures. We demonstrate the effectiveness of the learning with indirect supervision framework for many natural language processing tasks.

Graduation Semester

2011-12

Permalink

http://hdl.handle.net/2142/29768

Copyright and License Information

Copyright 2011 Ming-Wei Chang

Owning Collections