Analyzing Human Heuristics and Strategies in Everyday Decision-Making Conversations for Conversational AI Design
Sora Kang, Soyun Jeon, Jinsu Eun, Kwangwon Lee, Chaerin Song + 2 more
TLDR
This paper analyzes human decision-making heuristics in real-world conversations to inform the design of more human-aligned conversational AI.
Key contributions
- Analyzed 955 real-world Korean conversations on food/travel decisions using an LLM-assisted coding pipeline.
- Found people prioritize satisficing, using internal knowledge and interactional strategies to manage cognitive load.
- Identified a frequency-efficiency mismatch: frequent heuristics aid exploration, while infrequent rules drive resolution.
Why it matters
This research provides crucial empirical insights into how humans make everyday decisions conversationally. By understanding these natural heuristics, AI systems can be designed to better align with human cognitive processes, leading to more effective and intuitive conversational AI.
Original Abstract
Conversational AI increasingly supports everyday decision-making, yet most systems rely on data-centric reasoning rather than the heuristic and interactional strategies people use in natural conversation. To ground design in actual human practice, we analyze 955 real-world Korean conversations (15,476 utterances) involving food and travel decisions, applying a decision-making codebook through an LLM-assisted coding pipeline. Our findings reveal that people prioritize satisficing over optimization, relying heavily on internal knowledge and interactional strategies to manage cognitive load. Critically, we identify a frequency-efficiency mismatch: the most prevalent heuristics sustain conversational flow during exploration, whereas infrequent, rule-based strategies are highly effective at driving resolution during exploitation. By mapping how these patterns transfer across the spectrum of human-AI interaction, this work provides empirical grounding consistent with cognitive theories of decision-making and offers design implications that align AI systems with human heuristic processes.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.