Polarization-based underwater geolocalization with neural network models

Bai, Xiaoyang

Permalink

https://hdl.handle.net/2142/121977 Copy

Description

Title

Polarization-based underwater geolocalization with neural network models

Author(s)

Bai, Xiaoyang

Issue Date

2023-11-13

Director of Research (if dissertation) or Advisor (if thesis)

Schwing, Alexander

Doctoral Committee Chair(s)

Schwing, Alexander

Committee Member(s)

• Gruev, Viktor
• Forsyth, David
• Laze, Svetlana
• Schechner, Yoav

Department of Study

Computer Science

Discipline

Computer Science

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Underwater geolocalization
• Polarization-based underwater geolocalization
• Machine learning
• Computer vision
• Neural network

Abstract

Understanding the sea has always been a core theme of mankind's scientific endeavors. In recent years, the spatial and temporal scope of such exploration has been further expanded thanks to the rapid development of robot technologies. However, due to the unavailability of GPS signals underwater, efficient, high-accuracy and real-time navigation of man-made autonomous devices below the water surface remains an open challenge. Inspired by the visual system of marine animals such as mantis shrimps, polarization-based underwater geolocalization (PUG) aims to solve this problem by leveraging the rich polarization patterns generated by sunlight and moonlight as they are refracted and scattered underwater. Those patterns encode information about the celestial body's location in the sky, and once such information is extracted, one can subsequently combine it with the coordinated date and time when the observation is made to infer the observer's geolocation. In this thesis, we present a deep learning-based approach to PUG, which features higher accuracy, lower latency and better applicability to real-world scenarios than the existing parametric method. As a preliminary step, we develop a calibration algorithm to resolve the inherent angle of polarization (AoP) shift when the polarization camera is equipped with a wide-angle lens. This calibration algorithm enables us to use omnidirectional polarization images for training and evaluating our PUG methods. Next, we establish that rotation invariance and temporal modeling are the keys to designing network models that estimate sun location from omnidirectional polarization images. To this end, we propose RI-ResNet and RDM to address the two key points respectively and construct our learning-based PUG method by joining them with a particle filter (PF) geolocation estimator. We demonstrate that our method can learn to geolocalize in different sites, seasons, water types and depths. We have also proved the feasibility of PUG at nighttime for the first time ever. Finally, we focus our attention on improving model generalizability by proposing SecTran-M, a rotation invariant Transformer network, as the sun localization backbone and using unscented Kalman filter (UKF) for temporal modeling. Evaluation results on cross-site tasks show that our locally-trained model can achieve coarse-level geolocalization on a global scale, taking us one step closer to a globally functional high-accuracy PUG method that we have always envisioned.

Graduation Semester

2023-12

Type of Resource

Thesis

Copyright and License Information

Copyright 2023 Xiaoyang Bai

Owning Collections