ArXiv TLDR

AI Washing Inflates Expected Performance but Not Interaction Outcomes: An AI Placebo Study Using Fitts' Law

🐦 Tweet
2605.00582

Nick von Felten, Luisa Ella Müller, Johannes Schöning

cs.HCcs.AI

TLDR

AI washing inflates user performance expectations for input devices but doesn't improve objective or subjective interaction outcomes.

Key contributions

  • Conducted an AI placebo study using Fitts' Law with 28 participants and a computer mouse.
  • Found that "AI washing" significantly inflates user performance expectations.
  • These inflated expectations did not improve objective or subjective interaction outcomes.
  • Establishes Fitts' Law as a rigorous method for auditing AI-labeled input devices.

Why it matters

This paper exposes how deceptive AI marketing shapes user expectations without delivering real benefits. It underscores the urgent need for accountability and transparency in AI product claims.

Original Abstract

Expectations about the support of artificial intelligence (AI) may influence interaction outcomes similar to placebos. Such expectations may result from AI washing, a practice of overstating a system's AI capabilities when actual functionality is limited. For example, some computer mice are marketed as "AI-assisted" despite lacking AI in core functions. In a within-subjects study, 28 participants completed Fitts' Law tasks with a computer mouse under three conditions: no support, supposed predictive AI support, and supposed biosignal-enhanced AI support. Objective Fitts' Law performance indicators and subjective performance expectations, perceived workload, and perceived usability were measured. Compared to baseline, participants expected significantly improved performance in placebo conditions. However, these expectations did not translate into differences in objective or subjective assessments. This paper contributes evidence that AI washing inflates user expectations without altering actual interaction outcomes, highlighting a critical transparency issue. By exposing how deceptive AI marketing can shape user expectations, we underscore the need for accountability in AI product claims. Further, we establish Fitts' Law as a rigorous methodological lens for auditing AI-labelled input devices.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.