Single image scene relighting

Asthana, Pranav Kumar

Permalink

https://hdl.handle.net/2142/115440 Copy

Description

Title

Single image scene relighting

Author(s)

Asthana, Pranav Kumar

Issue Date

2022-04-28

Director of Research (if dissertation) or Advisor (if thesis)

Forsyth, David A

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

• computer graphics
• computer vision
• relighting
• self-supervised relighting
• light transport

Abstract

This thesis shows a relighting method that can relight a scene from a single image of that scene. It is well established that multiple distinctly lit images of a scene yield a light transport matrix that maps illuminants to shading fields and so to relit images. The work presented in this theses uses novel theory which says that one can use images of similar scenes to estimate the different lightings that apply to a given scene, with bounded expected error and explores various ways of selecting those images of similar scenes. This theory yields losses to train a relighting method using only unpaired images of scenes – multiple view data, Computer Generated Imagery (CGI) data or multiple relight data is not required for training. The method learns to map an image to a scene-specific relighting model consisting of a shading estimate, a light transport matrix, and a probability distribution over illuminants. The resulting model allows us to produce random relightings of a given scene that are plausible. The probability representation also allows us to produce relightings that are (a) close to a demand shading and (b) likely according to the predicted probability distribution, yielding controllable relighting. Qualitatively, the method’s relightings are easy to get for found data, but are not as good qualitatively as those obtained when multiple view or CGI data is available.

Graduation Semester

2022-05

Type of Resource

Thesis

Copyright and License Information

Copyright 2022 Pranav Asthana

Owning Collections