On the application of AI in subjective image editing
Chiu, Mang Tik
This item is only available for download by members of the University of Illinois community. Students, faculty, and staff at the U of I may log in with your NetID and password to view the item. If you are trying to access an Illinois-restricted dissertation or thesis, you can request a copy through your library's Inter-Library Loan office or purchase a copy directly from ProQuest.
Permalink
https://hdl.handle.net/2142/124495
Description
Title
On the application of AI in subjective image editing
Author(s)
Chiu, Mang Tik
Issue Date
2024-04-05
Director of Research (if dissertation) or Advisor (if thesis)
Shi, Humphrey
Doctoral Committee Chair(s)
Shi, Humphrey
Committee Member(s)
Hasegawa-Johnson, Mark A
Hwu, Wen-mei
Varshney, Lav R
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
Ph.D.
Degree Level
Dissertation
Keyword(s)
Computer Vision
AI
Deep Learning
Image
Editing
Abstract
Image editing is a laborious process, where a user must manually and meticulously add, modify, or change elements in the image to improve its aesthetics. A professional image editing task can take hours or more due to the level of detail required in the tasks, such as retouching seams and changing lighting conditions. On the other hand, for average users, image editing can also be a non-trivial task, since they do not have the expertise in the technical knowledge and the artistic vision. As a result, an automatic image editing tool can benefit both professional editors and casual users by taking over the labor-intensive process and reducing costs, while providing inspiration for creativity.
Nevertheless, image editing is also an inherently subjective task. This is because users can have different opinions on how to edit an image according to their preferences. For instance, one user may prefer a populated street and keep all the people, while another user may favor the scenery and thus wish to remove all pedestrians. This subjectivity poses new challenges in developing deep learning based image editing models, since there is no longer a single ground truth for the model to be trained on.
In this thesis, we propose a series of tasks in an attempt to tackle the application of AI in subjective image editing. We approach the topic in two ways: discriminative and generative. For discriminative automatic image editing, we study the task of visual distractor detection in two scenarios: wire segmentation in high-resolution images, where we constrain the type of distractor in uncommon image settings; and general distractor detection, where we study the properties of distractors in general. For generative image editing, we propose a new task of visual concept recommendation, which aims to recommend several sensible objects for insertion given the image context.
In each study, we provide a clear task definition and our proposed pipeline. We discuss methods of quantifying the subjectivity in each problem, and conduct comprehensive experiments to evaluate our methods.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.
