Director of Research (if dissertation) or Advisor (if thesis)
Kumar, Ranjitha
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
mobile design
generative models
gan
vae
design workflow
Abstract
User interface (UI) design is a central part of the mobile app creation process, which involves specifying the elements that should be placed on a screen, and how they should be arranged and styled. This paper introduces a generative model approach to predictive design for mobile UI layouts. Given a partial UI design, the model predicts the next UI element that should be added to the layout. Moreover, the model can be used queried multiple times in succession to autocomplete an entire UI screen. To power this design interaction, we present two types of models: generative adversarial networks (GANs) [7] and variational auto-encoders (VAEs) [15]. We train the GAN and VAE models over 1949 mobile UIs that represent a variety of screen types (e.g. Login, Onboarding), and compare both models along standard and design-based metrics, identifying key tradeoffs. Finally, we present a mobile UI mockup tool that leverages the GAN-based model to support a predictive design workflow.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
