Exploring the "Banality" of Deception in Generative AI
Ishitaa Narwane, Johanna Gunawan, Konrad Kollnig
TLDR
This paper explores "banal deception" in generative AI, where subtle, normalized influences blur the line between assistance and manipulation.
Key contributions
- Generative AI embeds "banal deception" in subtle ways like defaults and suggestions, unlike visible "dark patterns."
- Introduces "banality" as a lens to understand how deception operates in AI, especially chatbots.
- Highlights users' own involvement in their deception within AI interactions.
- Proposes future work to safeguard users through awareness, intervention tools, and regulatory improvements.
Why it matters
As generative AI becomes ubiquitous, understanding its subtle forms of deception is crucial. This paper provides a new framework, "banal deception," to analyze how AI quietly influences users, offering pathways for future safeguards.
Original Abstract
Current approaches to addressing deceptive design largely focus on visible interface manipulations, commonly referred to as "dark patterns". With the rise of generative AI, deception is becoming more difficult to spot and easier to live with, as it is quietly embedded in default settings, automated suggestions, and conversational interactions rather than discrete interface elements. These subtle, normalised forms of influence, which Simone Natale frames as "banal deception", shape everyday digital use and blur the line between AI-enabled assistance and manipulation. This position paper explores banality as a lens through which to reason through deception in generative AI experiences, especially with chatbots. We explore what Natale describes as users' own involvement in their deception, and argue that this perspective could lead to future work for introducing friction to safeguard users from deception in generative AI interactions, such as empowering users through raising awareness, providing them with intervention tools, and regulatory or enforcement improvements. We present these concepts as points for discussion for the deceptive design scholarly community.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.