Far touch: integrating visual and haptic perceptual processing on wearables

Targino Da Costa, Andre Luiz Nunes

Permalink

https://hdl.handle.net/2142/78418 Copy

Description

Title

Far touch: integrating visual and haptic perceptual processing on wearables

Author(s)

Targino Da Costa, Andre Luiz Nunes

Issue Date

2015-04-22

Director of Research (if dissertation) or Advisor (if thesis)

Do, Minh N.

Doctoral Committee Chair(s)

Do, Minh N.

Committee Member(s)

• Moulin, Pierre
• Simons, Daniel J.
• Smaragdis, Paris

Department of Study

Electrical & Computer Eng

Discipline

Electrical & Computer Engr

Degree Granting Institution

University of Illinois at Urbana-Champaign

Degree Name

Ph.D.

Degree Level

Dissertation

Keyword(s)

• Signal Processing
• Perception
• Wearables
• Vision
• Haptics
• Touch
• Image Processing
• Foveation
• Compression
• Perceptually Lossless Compression
• Lossy Compression
• Electrotactile
• Active Touch
• Passive Touch
• Visual-Haptic Environment
• Haptic Environment
• Sensitivity Index
• Response Bias

Abstract

The evolution of electronic computers seems to have now reached the ubiquitous realm of wearable computing. Although a vast gamut of systems has been proposed so far, we believe most systems lack proper feedback for the user. In this dissertation, we not only contribute to solving the feedback problem, but we also consider the design of a system to acquire and reproduce the sense of touch. In order for such a system to be feasible, a few important problems need to be considered. Here, we address two of them. First, we know that wireless streaming of high resolution video to a head-mounted display requires high compression ratio. Second, we know that the choice of a proper feedback for the user depends on his/her ability to perceive it confidently across different scenarios. In order to solve the first problem, we propose a new limit that promises theoretically achievable data reduction ratios up to approximately 9:1 with no perceptual loss in typical scenarios. Also, we introduce a novel Gaussian foveation scheme that provides experimentally achievable gains up to approximately 2 times the compression ratio of typical compression schemes with less perceptual loss than in typical transmissions. The background material of both the limit and the foveation scheme includes a proposed pointwise retina-based constraint called pixel efficiency, that can be globally processed to reveal the perceptual efficiency of a display, and can be used together with a lossy parameter to locally control the spatial resolution of a foveated image. In order to solve the second problem, we provide an estimation of difference threshold that suggests that typically humans are able to discriminate between at least 6 different frequencies of an electrotactile stimulation. Also, we propose a novel sequence of experiments that suggests that a change from active touch to passive touch, or from a visual-haptic environment to a haptic environment, typically yields a reduction of the sensitivity index d' and in an increase of the response bias c.

Graduation Semester

2015-5

Type of Resource

text

Permalink

http://hdl.handle.net/2142/78418

Copyright and License Information

Copyright 2015 André Targino

Owning Collections