Artificial intelligence and visual discourse : a multimodal critical discourse analysis of AI-generated images of “Dementia”

Putland, Emma and Chikodzore-Paterson, Chris and Brookes, Gavin (2023) Artificial intelligence and visual discourse : a multimodal critical discourse analysis of AI-generated images of “Dementia”. Social Semiotics. ISSN 1035-0330

[thumbnail of AI_dementia_images_article]
Text (AI_dementia_images_article) - Accepted Version
Restricted to Repository staff only until 1 January 2040.
Available under License Creative Commons Attribution.

Download (0B)
[thumbnail of AI_dementia_images_article]
Text (AI_dementia_images_article)
AI_dementia_images_article.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (2MB)

Abstract

This article examines the ideologies reproduced in AI-generated images, focusing in particular on representations of dementia. Utilising Stable Diffusion version 1.4, a text-to-image AI model, we conduct a multimodal critical discourse analysis of 171 images generated from the text prompt “dementia.” Our analysis aims to identify and contextualise the visual discourses within the generated images by comparing these with existing multimodal representations of dementia. As well as observing a general lack of visual diversity (with an over-representation of older, light-skinned individuals), we find that these images tend to depict dementia by recycling existing, prominent visual discourses surrounding the syndrome, including a biomedical focus on the disease, narratives of loss, and dementia as a “living death.” These visual discourses combine with particular semiotic choices that promote emotional distance between viewers and people with dementia. Overall, this study highlights the potential for AI-generated images to reinforce and amplify harmful stereotypes and biases. As well as demonstrating the ideological import of such imagery, and thus the need for these to be critically interrogated by (multimodal) critical discourse analysts, this study underscores the need for ethical consideration in AI design and usage, including developing more diverse and inclusive training datasets.

Item Type:
Journal Article
Journal or Publication Title:
Social Semiotics
Uncontrolled Keywords:
Research Output Funding/yes_externally_funded
Subjects:
?? dementiaai-generated imagesmultimodal critical discourse analysisyes - externally fundednocultural studiescommunicationlinguistics and languagelanguage and linguistics ??
ID Code:
210632
Deposited By:
Deposited On:
28 Nov 2023 14:40
Refereed?:
Yes
Published?:
Published
Last Modified:
28 Mar 2024 01:05