Towards vision based robots for monitoring built environments

Degol, Joseph

Permalink

https://hdl.handle.net/2142/101504 Copy

Description

Title

Towards vision based robots for monitoring built environments

Author(s)

Degol, Joseph

Issue Date

2018-06-26

Director of Research (if dissertation) or Advisor (if thesis)

Hoiem, Derek

Doctoral Committee Chair(s)

Hoiem, Derek

Committee Member(s)

• Bretl, Timothy
• Golparvar-Fard, Mani
• Forsyth, David
• Sinha, Sudipta

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

Computer Vision, 3D Reconstruction, Fiducial Markers, Material Recognition, Construction Progress Monitoring, Robotics, Drones, Structure from Motion

Abstract

In construction, projects are typically behind schedule and over budget, largely due to the difficulty of progress monitoring. Once a structure (e.g. a bridge) is built, inspection becomes an important yet dangerous and costly job. We can provide a solution to both problems if we can simplify or automate visual data collection, monitoring, and analysis. In this work, we focus specifically on improving autonomous image collection, building 3D models from the images, and recognizing materials for progress monitoring using the images and 3D models. Image capture can be done manually, but the process is tedious and better suited for autonomous robots. Robots follow a set trajectory to collect data of a site, but it is unclear if 3D reconstruction will be successful using the images captured by following this trajectory. We introduce a simulator that synthesizes feature tracks for 3D reconstruction to predict if images collected from a planned path will result in a successful 3D reconstruction. This can save time, money, and frustration because robot paths can be altered prior to the real image capture. When executing a planned trajectory, the robot needs to understand and navigate the environment autonomously. Robot navigation algorithms struggle in environments with few distinct features. We introduce a new fiducial marker that can be added to these scenes to increase the number of distinct features and a new detection algorithm that detects the marker with negligible computational overhead. Adding markers prior to data collection does not guarantee that the algorithms for 3D model generation will succeed. In fact, out of the box, these algorithms do not take advantage of the unique characteristics of markers. Thus, we introduce an improved structure from motion approach that takes advantage of marker detections when they are present. We also create a dataset of challenging indoor image collections with markers placed throughout and show that previous methods often fail to produce accurate 3D models. However, our approach produces complete, accurate 3D models for all of these new image collections. Recognizing materials on construction sites is useful for monitoring usage and tracking construction progress. However, it is difficult to recognize materials in real world scenes because shape and appearance vary considerably. Our solution is to introduce the first dataset of material patches that include both image data and 3D geometry. We then show that both independent and joint modeling of geometry are useful alongside image features to improve material recognition. Lastly, we use our material recognition with material priors from building plans to accurately identify progress on construction sites.

Graduation Semester

2018-08

Type of Resource

text

Permalink

http://hdl.handle.net/2142/101504

Copyright and License Information

Copyright 2018 by Joseph DeGol. All rights reserved.

Owning Collections