Augmenting complex surfaces with projector-camera systems

Jones, Brett R.

Permalink

https://hdl.handle.net/2142/18407 Copy

Description

Title

Augmenting complex surfaces with projector-camera systems

Author(s)

Jones, Brett R.

Issue Date

2011-01-14T22:49:30Z

Director of Research (if dissertation) or Advisor (if thesis)

Campbell, Roy H.

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

M.S.

Degree Level

Thesis

Keyword(s)

• spatial augmented reality
• projection mapping
• projector
• camera
• projector-camera
• interactive surface particles

Abstract

Display and interaction real-estate is fundamentally limited by the size of the screen in traditional display devices. Projection-based interfaces allow interaction with appropriated, everyday, passive surfaces. Instead of restricting interaction to a single rectangle, projection-based augmented reality makes interaction ubiquitous, taking the computer out of the box. Extending interaction to almost any surface enables new possibilities in a host of new domains, including entertainment, consumer electronics, advertising, medicine and many more. Overlaying virtual elements onto complex physical surfaces under real-world conditions, presents a variety of challenges, many which are open research problems. A wealth of previous work has focused on projection onto constrained surfaces like planes, parabolic curves, etc. In this research, we explore projection onto arbitrarily complex physical surfaces. We describe a complete, practical approach embodied in a projector-camera system. Our system is constructed of low-cost, commodity hardware and demonstrates some of the exciting applications of Spatial Augmented Reality. We present a novel initial homography estimation for interactive projector-camera calibration. We introduce a unique hybrid projector pattern codification technique for improved correspondences. Finally, we present interactive surface particles, which are a surface independent content representation that enables reusable interaction with complex physical surfaces. This thesis outlines the fundamental preliminaries of projector-camera systems, the current state of the art, along with our design decisions, implementation details and results. Covered topics include camera calibration, structured light 3D scanning and surface augmentation. This work demonstrates the technical and practical feasibility of appropriating complex surfaces as information displays; hopefully encouraging a future where a display device is no longer a discrete entity, but where our environment is our display and interface.

Graduation Semester

2010-12

Permalink

http://hdl.handle.net/2142/18407

Copyright and License Information

Copyright 2010 Brett Jones

Owning Collections