Director of Research (if dissertation) or Advisor (if thesis)
Schwing, Alexander
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
machine learning
computer vision
instance segmentation
amodal segmentation
Abstract
We explore approaches to improve over existing amodal prediction models for the task of semantic amodal instance level video object segmentation, i.e., the task to delineate objects and their occluded parts in video data. We propose Amodal-Net with three improvements: First, we leverage temporal information. Specifically, we employ 3D convolutions and a flow alignment module which permits to aggregate the objects’ features across frames. Second, we develop a cascaded box-head with soft-non-maximum-suppression to address the challenge that amodal segmentations overlap significantly. Third, we address the challenge that occlusions require observation information to be propagated over larger distances by developing an attention-based mask-head. Then we also study reprojection, another way of using temporal information which also uses 3D information. We evaluate our approach on amodal segmentation for video data, SAILVOS.
Use this login method if you
don't
have an
@illinois.edu
email address.
(Oops, I do have one)
IDEALS migrated to a new platform on June 23, 2022. If you created
your account prior to this date, you will have to reset your password
using the forgot-password link below.