ArXiv TLDR

Can providing feedback on gaze and mental-effort synchrony improve pair programming performance?

🐦 Tweet
2605.05836

Anahita Golrang, Kshitij Sharma

cs.HC

TLDR

AI feedback on gaze and mental effort synchrony significantly improves pair programming performance, with proactive timing being most effective.

Key contributions

  • AI-supported feedback on joint gaze and mental effort improves pair programming performance.
  • Reactive feedback, intervening on gaze/effort deviations, significantly boosts debugging success and efficiency.
  • Proactive, ML-forecasted feedback further enhances performance, reduces task time, and increases constructive uptake.
  • Proactive feedback is less intrusive, preserves learner agency, and particularly benefits high-performing pairs.

Why it matters

This research demonstrates how AI feedback, based on real-time gaze and mental effort synchrony, significantly improves pair programming performance. It highlights that proactive, anticipatory interventions are key to superior outcomes and preserving learner autonomy. This offers a novel approach to human-AI collaboration in education.

Original Abstract

Pair programming is a widely used collaborative learning practice in computer science education yet its effectiveness varies substantially due to breakdowns in coordination attention and cognitive regulation between partners. This paper investigates whether AI supported feedback grounded in joint visual attention and joint mental effort can improve collaborative programming performance and how feedback timing shapes learner AI interaction. Two experimental studies using dual eye tracking capture real time indicators of collaborative regulation during debugging tasks. Study 1 examines reactive feedback that intervenes when observed joint visual attention or joint mental effort deviates beyond predefined thresholds while Study 2 evaluates proactive feedback that forecasts future regulatory breakdowns using machine learning models and intervenes pre emptively. Across both studies feedback effectiveness is assessed through debugging success time on task and feedback uptake reflected in code changes. Multimodal feedback significantly improves collaborative performance compared to no feedback conditions. Reactive feedback yields strong gains in debugging success and efficiency particularly when joint visual attention and joint mental effort based feedback are combined. Proactive forecast based feedback further enhances performance reduces time on task and increases constructive feedback uptake while relying less on intrusive interventions. Proactive feedback better preserves learner agency by maintaining optimal collaboration states, particularly for high-performing pairs. These findings demonstrate that gaze and mental effort synchrony can serve as reliable actionable triggers for AI supported collaborative learning highlighting the importance of feedback timing transparency and anticipatory regulation in supporting effective pair programming.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.