What People See (and Miss) About Generative AI Risks: Perceptions of Failures, Risks, and Who Should Address Them
Megan Li, Wendy Bickersteth, Ningjing Tang, Parv Kapoor, Khinezin Win + 5 more
TLDR
This paper surveys 960 U.S. participants to understand public perceptions of Generative AI risks, failure modes, and who should address them.
Key contributions
- Developed a survey to assess public perception of GenAI risks, failure modes, and stakeholder responsibilities.
- Survey validated by experts and deployed to 960 U.S. participants, using real-world scenarios.
- Found the survey effective for assessing risk awareness and informing AI literacy tools.
- Advocates for AI literacy and governance aligned with how people encounter GenAI daily.
Why it matters
This paper addresses a critical gap in understanding public perceptions of Generative AI risks and their failure modes. Its findings are crucial for designing effective AI literacy tools and governance strategies that align with how people encounter GenAI in everyday life.
Original Abstract
Despite growing concerns about the risks of Generative AI (GenAI), there is limited understanding of public perceptions of these risks and their associated failure modes -- defined as recurring patterns of sociotechnical breakdown across the GenAI lifecycle that contribute to risks of real-world harm. To address this gap, we present a survey instrument, validated with eight subject matter experts and deployed on a sample of 960 U.S.-based participants, to assess awareness and perceptions of GenAI's failure modes, their associated risks, and stakeholder responsibilities to address them. To support realism and content validity, our instrument is structured around scenarios grounded in publicly reported incidents and a taxonomy of GenAI's failure modes. Findings suggest that our instrument is (1) effective for assessing risk awareness and perceptions in a way that is grounded in people's current contexts of use, yet is extensible to new contexts that will inevitably arise; and (2) potentially useful for informing the design of AI literacy tools and interventions. We argue for AI literacy and governance approaches that align with how people encounter and reason about GenAI in everyday life.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.