University of Illinois Urbana-Champaign

Single image scene relighting

Asthana, Pranav Kumar

Content Files
ASTHANA-THESIS-2022.pdf

Permalink

https://hdl.handle.net/2142/115440

Description

Title
Single image scene relighting
Author(s)
Asthana, Pranav Kumar
Issue Date
2022-04-28
Director of Research (if dissertation) or Advisor (if thesis)
Forsyth, David A
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
  • computer graphics
  • computer vision
  • relighting
  • self-supervised relighting
  • light transport
Abstract
This thesis shows a relighting method that can relight a scene from a single image of that scene. It is well established that multiple distinctly lit images of a scene yield a light transport matrix that maps illuminants to shading fields and so to relit images. The work presented in this theses uses novel theory which says that one can use images of similar scenes to estimate the different lightings that apply to a given scene, with bounded expected error and explores various ways of selecting those images of similar scenes. This theory yields losses to train a relighting method using only unpaired images of scenes – multiple view data, Computer Generated Imagery (CGI) data or multiple relight data is not required for training. The method learns to map an image to a scene-specific relighting model consisting of a shading estimate, a light transport matrix, and a probability distribution over illuminants. The resulting model allows us to produce random relightings of a given scene that are plausible. The probability representation also allows us to produce relightings that are (a) close to a demand shading and (b) likely according to the predicted probability distribution, yielding controllable relighting. Qualitatively, the method’s relightings are easy to get for found data, but are not as good qualitatively as those obtained when multiple view or CGI data is available.
Graduation Semester
2022-05
Type of Resource
Thesis
Handle URL
https://hdl.handle.net/2142/115440
Copyright and License Information
Copyright 2022 Pranav Asthana

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois