To "See" is to Stereotype: Image Tagging Algorithms, Gender Recognition, and the Accuracy – Fairness Trade-of release_n6cfjopz3ndb5jjhiwmsr64ykm

by Pinar Barlas, Kyriakos Kyriakou, Olivia Guest, Styliani Kleanthous, Jahna Otterbacher

Published by Zenodo.

2020  

Abstract

Machine-learned computer vision algorithms for tagging images are increasingly used by developers and researchers, having become popularized as easy-to-use "cognitive services." Yet these tools struggle with gender recognition, particularly when processing images of women, people of color and non-binary individuals. Socio-technical researchers have cited data bias as a key problem; training datasets often over-represent images of people and contexts that convey social stereotypes. The social psychology literature explains that people learn social stereotypes, in part, by observing others in particular roles and contexts, and can inadvertently learn to associate gender with scenes, occupations and activities. Thus, we study the extent to which image tagging algorithms mimic this phenomenon. We design a controlled experiment, to examine the interdependence between algorithmic recognition of context and the depicted person's gender. In the spirit of auditing to understand machine behaviors, we create a highly controlled dataset of people images, imposed on gender-stereotyped backgrounds. Our methodology is reproducible and our code publicly available. Evaluating five proprietary algorithms, we find that in three, gender inference is hindered when a background is introduced. Of the two that "see" both backgrounds and gender, it is the one whose output is most consistent with human stereotyping processes that is superior in recognizing gender. We discuss the accuracy – fairness trade-off, as well as the importance of auditing black boxes in better understanding this double-edged sword.
In text/plain format

Archived Files and Locations

application/pdf  1.2 MB
file_2qjuxenswzcgtf3e4kl7hqxrwi
zenodo.org (repository)
web.archive.org (webarchive)
Read Archived PDF
Preserved and Accessible
Type  article-journal
Stage   published
Date   2020-09-14
Work Entity
access all versions, variants, and formats of this works (eg, pre-prints)
Catalog Record
Revision: a2516257-ff88-4832-a3fd-98f1531f61d7
API URL: JSON