Enabling type differentiated explainable queries across modalities for different fashion items
Dusad, Krishna
Loading…
Permalink
https://hdl.handle.net/2142/105108
Description
Title
Enabling type differentiated explainable queries across modalities for different fashion items
Author(s)
Dusad, Krishna
Issue Date
2019-04-26
Director of Research (if dissertation) or Advisor (if thesis)
Forsyth, David A.
Kumar, Ranjitha
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
Machine Learning
Artificial Intelligence
Human-Computer Interaction
Abstract
One of the biggest differences between shopping online and in person is the limited scope and expressibility of the queries that current systems allow and can handle. In person, users often employ a combination of linguistic and visual tools at their disposal to create complex queries. Handling such queries requires modeling relationships between products of the same type, products of different types, products and outfits, and products and their attributes. In this paper, we propose a system that models these relationships by: (i) building a robust visual representation of items that captures notions of similarity and compatibility between products, (ii) learning to predict low-level (color, type) and high-level (style, brand) attributes of the items from their visual representations, and (iii) learning segment-wise maps of outfits to items. For each part, we evaluate the model by demonstrating its performance on relevant tasks like outfit completion, item retrieval, etc., and flexibility through example results for complex queries.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
