University of Illinois Urbana-Champaign

Expanding commonsense knowledge bases by learning from image tags

Mauceri, Cecilia R

Content Files
MAUCERI-THESIS-2015.pdf

Permalink

https://hdl.handle.net/2142/88091

Description

Title
Expanding commonsense knowledge bases by learning from image tags
Author(s)
Mauceri, Cecilia R
Issue Date
2015-07-20
Director of Research (if dissertation) or Advisor (if thesis)
Lazebnik, Svetlana
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2015-09-29T20:38:44Z
Keyword(s)
  • Commonsense knowledge
  • transfer learning
  • image collection
  • knowledge extraction
Abstract
I present a method for learning new commonsense facts to augment existing commonsense knowledge bases by using the metadata of large online image collections. Online image collections present a source of knowledge that is supported by many contributors, has good representation of objects and their properties, and is visual. The collection's broad support of objects and object properties ensure the relevance and quality of the commonsense knowledge collected, while the visual focus provides a different subset of knowledge than typical text corpora. Using the image metadata provides a text representation of the visual information. Therefore, I can use classifiers trained on existing text-based knowledge bases to learn relationships between concepts represented in the images. I collect two datasets of more than 1 million images each, one consisting of animal images, one of room interiors. The images are tagged with relevant concepts by their owners. I train classifiers using facts from two popular commonsense knowledge bases, ConceptNet and Freebase, to classify the relationships between frequent concept pairs. The output is a list of more than 90,000 proposed facts, which are in neither source knowledge base.
Graduation Semester
2015-8
Type of Resource
text
Permalink
http://hdl.handle.net/2142/88091
Copyright and License Information
Copyright 2015 Cecilia Mauceri

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Computer Science
Dissertations and Theses from the Siebel School of Computer Science