University of Illinois Urbana-Champaign

Investigating pre-touch sensing to predict grip success in compliant grippers using machine learning techniques

Walt, Benjamin Thomas

Content Files
WALT-THESIS-2020.pdf

Permalink

https://hdl.handle.net/2142/108527

Description

Title
Investigating pre-touch sensing to predict grip success in compliant grippers using machine learning techniques
Author(s)
Walt, Benjamin Thomas
Issue Date
2020-07-22
Director of Research (if dissertation) or Advisor (if thesis)
Krishnan, Girish
Department of Study
Mechanical Sci & Engineering
Discipline
Mechanical Engineering
Degree Granting Institution
University of Illinois at Urbana-Champaign
Degree Name
M.S.
Degree Level
Thesis
Date of Ingest
2020-10-07T21:00:06Z
Keyword(s)
  • robotics
  • soft robotics
  • gripper
  • pre-touch sensing
  • machine learning
  • grip prediction
Abstract
This work explores the application of pre-touch sensing to a compliant gripper in order to navigate the last few centimeters while grasping fruit in an occluded, cluttered environment. Machine learning was used in conjunction with pre-touch sensors to provide qualitative feedback about the success of the gripper in picking the target fruit prior to contact. Three compliant grippers were each designed to pick a specific fruit (miracle berries, cherry tomatoes and small figs) without damaging them. These grippers were designed to be mounted on the hybrid soft-rigid arm of a mobile field robot. An IR reflectance, time of flight and color sensor were used as pre-touch sensors and arranged on the gripper in various combinations to explore the contribution of each sensor. The gripper-sensor system was trained by positioning it relative to a dummy fruit using a 6 DOF arm and gripping the target. Using the training data, five machine learning methods were explored: nearest neighbor, decision trees, support vector machines, multi-layer perceptrons and a naive Bayes classifier. The various sensor configuration-machine learning combinations were tested and evaluated based on their ability to predict grip success. Additional training was conducted to demonstrate the ability to differentiate fruit from foreign matter (e.g. leaves) that are in the gripper opening. Time of flight sensors using nearest neighbor and support vector machines along with the set of all three sensors using support vector machines and multi-layer perceptrons showed the highest prediction precision (= 90%) with the color sensor playing a key role in detecting foreign objects. The machine learning methods were similar in their ability to predict grip success with nearest neighbor showing the best overall results, while sensor ‘richness’ play an important role in differentiating the sensors with the three sensor combination showing the best results.
Graduation Semester
2020-08
Type of Resource
Thesis
Permalink
http://hdl.handle.net/2142/108527
Copyright and License Information
Copyright 2020 Benjamin Thomas Walt

Owning Collections

Graduate Dissertations and Theses at Illinois PRIMARY
Graduate Theses and Dissertations at Illinois
Dissertations and Theses - Mechanical Science and Engineering