Heterogeneous Feature Fusion for Visual Recognition

Cao, Liangliang

Permalink

https://hdl.handle.net/2142/26213 Copy

Description

Title

Heterogeneous Feature Fusion for Visual Recognition

Author(s)

Cao, Liangliang

Issue Date

2011-08-25T22:19:06Z

Director of Research (if dissertation) or Advisor (if thesis)

Huang, Thomas S.

Doctoral Committee Chair(s)

Huang, Thomas S.

Committee Member(s)

• Han, Jiawei
• Luo, Jiebo
• Ahuja, Narendra
• Hasegawa-Johnson, Mark A.

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• visual recognition
• heterogeneous feature machines
• action detection
• geophoto memex

Abstract

In the past decade, the popularity of the Internet and digital cameras has led to a flourishing of images and videos. Surveillance videos are increasing explosively with the huge amounts of surveillance cameras. Compared with traditional datasets in computer vision, which host only thousands of images, these large-scale datasets in the era of the Internet have grown beyond the wildest imagination, and posed a serious challenge for visual recognition and detection. To handle the challenge of visual recognition in complicated scenarios, we believe that a single feature is not enough to distinguish web-scale visual concepts. Accordingly, this dissertation proposes to combine heterogeneous features for different visual recognition tasks. We first develop a machinery called Heterogeneous Feature Machines to effectively fuse multiple types of visual features. In addition, we realize that in specific applications such as consumer photo annotation or surveillance action detection, there are also specific cues which are helpful for visual recognition tasks. We consider three scenarios: (1) consumer photo recognition, where we explore the use of metadata such as time and GPS, (2) Web image searching and annotation, where we combine both user tags and network information for visual applications, and (3) action detection in videos, where the spatial-temporal coherence is combined with multiple visual features for detection tasks. We believe heterogeneous feature fusion is useful in a wide range of applications and merits research efforts in this promising direction.

Graduation Semester

2011-08

Permalink

http://hdl.handle.net/2142/26213

Copyright and License Information

Copyright 2011 Liangliang Cao

Owning Collections