University of Illinois Urbana-Champaign

Monocular depth prediction with object removal from single image

Issaranon, Theerasit

Content Files
ISSARANON-THESIS-2019.pdf

Permalink

https://hdl.handle.net/2142/105848

Description

Title
Monocular depth prediction with object removal from single image
Author(s)
Issaranon, Theerasit
Issue Date
2019-07-12
Director of Research (if dissertation) or Advisor (if thesis)
Forsyth, David
Department of Study
Electrical & Computer Eng
Discipline
Electrical & Computer Engr
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2019-11-26T20:56:42Z
Keyword(s)
  • Single-Image Depth Prediction
  • Object Removal
  • Occluded Vision
Abstract
We describe a method that predicts, from a single RGB image, a depth map that describes the scene when a masked object is removed – we call this “counterfactual depth” that models hidden scene geometry together with the observations. Our method works for the same reason that scene completion works: the spatial structure of objects is simple. But we offer a much higher resolution representation of space than current scene completion methods, as we operate at pixel-level precision and do not rely on a voxel representation. We can remove objects arbitrarily with an instructed object mask. Furthermore, we do not require RGBD inputs. Our method uses a standard encoder-decoder architecture, with a decoder modified to accept an object mask. We systematically construct a small evaluation dataset that we have collected. Using this dataset, we show that our depth predictions for masked objects are better than other baselines in the real scene. Given unmasked images, our approach performs comparatively well as a regular scene depth predictor.
Graduation Semester
2019-08
Type of Resource
text
Permalink
http://hdl.handle.net/2142/105848
Copyright and License Information
Copyright 2019 Theerasit Issaranon

Owning Collections

Dissertations and Theses - Electrical and Computer Engineering
Dissertations and Theses in Electrical and Computer Engineering
Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois