Enabling mobile robot perception and shared-control with vision-based sensor fusion systems

Chen, Yu

Permalink

https://hdl.handle.net/2142/122017 Copy

Description

Title

Enabling mobile robot perception and shared-control with vision-based sensor fusion systems

Author(s)

Chen, Yu

Issue Date

2023-11-30

Director of Research (if dissertation) or Advisor (if thesis)

• Norris, William R
• Hsiao-Wecksler, Elizabeth T

Doctoral Committee Chair(s)

• Norris, William R
• Hsiao-Wecksler, Elizabeth T

Committee Member(s)

• Ramos, João
• Sreenivas, Ramavarapu S
• Driggs-Campbell, Katie
• Wang, YuXiong

Department of Study

Mechanical Sci & Engineering

Discipline

Mechanical Engineering

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• self-balancing robot
• robot perception
• vision sensor
• sensor fusion
• shared-control
• Deep Learning for Visual Perception
• RGB-D Perception
• Vision-Based Navigation

Abstract

Mobile robots with various locomotion mechanisms have been developed to adapt to different environmental conditions and mission requirements. The advancement in mobile robot development has raised the requirements for robot perception to ensure the safe and smooth execution of robot missions. In the past decade, the emergence of a novel self-balancing mobile robot system, known as the ballbot, has opened up new avenues of research in the field of mobile robots. While offering enhanced maneuverability, the under-actuated dynamics of the ballbot invalidate most existing ground robot perception solutions. Moreover, when the ballbot is designed as a riding mobility device, it imposes additional demands and constraints on robot perception and human-robot shared motion control. Specifically, the ballbot’s omnidirectional capability requires operators to possess significant proficiency and experience in riding and controlling the platform effectively. To address these challenges, there is a critical need for advanced and innovative robot perception techniques and higher-level control systems that can reduce the operator’s cognitive load and ensure system safety by preventing unwanted collisions. This dissertation aims to investigate robot perception and safeguarding challenges by leveraging vision-based sensor fusion techniques and commonly available commercial sensors. The research specifically focuses on developing robot perception and shared-control systems that can be deployed on a physical ballbot prototype, adhering to strict Size-Weight-and-Power Constraints (SWaP-C), while also being generalizable to mobile robots with simpler or similar dynamic characteristics as ballbots.

Graduation Semester

2023-12

Type of Resource

Thesis

Copyright and License Information

Copyright 2023 Yu Chen

Owning Collections