ArXiv TLDR

A Sociotechnical, Practitioner-Centered Approach to Technology Adoption in Cybersecurity Operations: An LLM Case

🐦 Tweet
2604.21679

Francis Hahn, Mohd Mamoon, Alexandru G. Bardas, Michael Collins, Daniel Lende + 2 more

cs.CR

TLDR

A sociotechnical, practitioner-centered co-creation approach successfully drives LLM adoption in cybersecurity operations by addressing trust and workflow issues.

Key contributions

  • Identified recurring SOC challenges like repetitive tasks, fragmented data, and tooling bottlenecks via fieldwork.
  • Co-created LLM companion tools with practitioners, improving efficiency and interpretability in workflows.
  • Iterative refinement led to sustained LLM adoption in SOCs, overcoming initial skepticism and disruption.
  • Sociotechnical co-creation (SECI model) provides a new paradigm for usable cybersecurity technology.

Why it matters

This paper offers a practical framework for integrating AI, specifically LLMs, into sensitive cybersecurity operations. It demonstrates how a co-creation approach can overcome common adoption barriers, fostering trust and usability. This is crucial for leveraging AI in critical security contexts.

Original Abstract

Technology for security operations centers (SOCs) has a storied history of slow adoption due to concerns about trust and reliability. These concerns are amplified with artificial intelligence, particularly large language models (LLMs), which exhibit issues such as hallucinations and inconsistent outputs. To assess whether LLM-based tools can improve SOC efficiency, we embedded two PhD researchers within a multinational company SOC for six months of ethnographic fieldwork. We identified recurring challenges, such as repetitive tasks, fragmented/unclear data, and tooling bottlenecks, and collaborated directly with practitioners to develop LLM companion tools aligned with their operational needs. Iterative refinement reduced workflow disruption and improved interpretability, leading from skepticism to sustained adoption. Ethnographic analysis indicates that this shift was enabled by our sociotechnical co-creation process consistent with Nonaka's SECI model. This framework explains the common challenges in traditional SOC technology adoption, including workflow misalignment, rigidity against evolving threats and internal requirements, and stagnation over time. Our findings show that the co-creation approach can overcome these old barriers and create a new paradigm for creating usable technology for cybersecurity operations.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.