University of Illinois Urbana-Champaign

Visual servoing for pose control of soft continuum arms

Kamtikar, Shivani

Content Files
KAMTIKAR-THESIS-2022.pdf

Permalink

https://hdl.handle.net/2142/115778

Description

Title
Visual servoing for pose control of soft continuum arms
Author(s)
Kamtikar, Shivani
Issue Date
2022-04-26
Director of Research (if dissertation) or Advisor (if thesis)
Chowdhary, Girish
Department of Study
Computer Science
Discipline
Computer Science
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Keyword(s)
  • robotics
  • soft continuum arms
  • computer vision
  • visual servoing
  • pose control
  • manipulation
  • neural networks
  • learning-based robotics
Abstract
For soft continuum arms, visual servoing is a popular control strategy that relies on visual feedback to close the control loop. However, robust visual servoing is challenging as it requires reliable feature extraction from the image, accurate control models and sensors to perceive the shape of the arm, both of which can be hard to implement in a soft robot. This research circumvents these challenges by presenting a deep neural network-based method to perform smooth and robust 3D positioning tasks on a soft arm by visual servoing using a camera mounted at the distal end of the arm. A convolutional neural network is trained to predict the actuations required to achieve the desired pose in a structured environment. Integrated and modular approaches for estimating the actuations from the image are proposed and are experimentally compared. A proportional control law is implemented to reduce the error between the desired and current image as seen by the camera. The model together with the proportional feedback control makes the described approach robust to several variations such as new targets, lighting, loads, and diminution of the soft arm. Furthermore, the model lends itself to be transferred to a new environment with minimal effort.
Graduation Semester
2022-05
Type of Resource
Thesis
Handle URL
https://hdl.handle.net/2142/115778
Copyright and License Information
Copyright 2022 Shivani Kiran Kamtikar

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois