University of Illinois Urbana-Champaign

Disability-first design and creation of a dataset showing private visual information collected with people who are blind

Sharma, Tanusree; Stangl, Abigale; Zhang, Lotus; Tseng, Yu-Yun; Xu, Inan; Findlater, Leah; Gurari, Danna; Wang, Yang

Permalink

https://hdl.handle.net/2142/122290

Description

Title
Disability-first design and creation of a dataset showing private visual information collected with people who are blind
Author(s)
  • Sharma, Tanusree
  • Stangl, Abigale
  • Zhang, Lotus
  • Tseng, Yu-Yun
  • Xu, Inan
  • Findlater, Leah
  • Gurari, Danna
  • Wang, Yang
Issue Date
2023-04-19
Keyword(s)
  • dataset
  • accessibility
  • privacy
  • personal visual data
  • visual assistance
  • visual interpretation
  • image description
  • computer vision
  • visual impairments
  • blind
Abstract
We present the design and creation of a disability-first dataset, “BIV-Priv,” which contains 728 images and 728 videos of 14 private categories captured by 26 blind participants to support downstream development of artificial intelligence (AI) models. While best practices in dataset creation typically attempt to eliminate private content, some applications require such content for model development. We describe our approach in creating this dataset with private content in an ethical way, including using props rather than participants’ own private objects and balancing multi-disciplinary perspectives (e.g., accessibility, privacy, computer vision) to meet the tangible metrics (e.g., diversity, category, amount of content) to support AI innovations. We observed challenges that our participants encountered during the data collection, including accessibility issues (e.g., understanding foreground vs. background object placement) and issues due to the sensitive nature of the content (e.g., discomfort in capturing some props such as condoms around family members).
Publisher
ACM
Has Part
10.1145/3544548.3580922
Series/Report Name or Number
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
Type of Resource
text
Language
eng
Sponsor(s)/Grant Number(s)
  • e National Science Foundation (NSF) grants #2126314
  • e National Science Foundation (NSF) grants #2028387
  • National Science Foundation (NSF) grants #2125925
  • National Science Foundation (NSF) grants #2148080

Owning Collections

Student Publications and Research - Information Sciences PRIMARY
Publications, conference papers, and other research and scholarship of iSchool students.