ArXiv TLDR

TwinGate: Stateful Defense against Decompositional Jailbreaks in Untraceable Traffic via Asymmetric Contrastive Learning

🐦 Tweet
2604.27861

Bowen Sun, Chaozhuo Li, Yaodong Yang, Yiwei Wang, Chaowei Xiao

cs.CRcs.CLcs.LG

TLDR

TwinGate uses asymmetric contrastive learning to defend LLMs against decompositional jailbreaks in untraceable traffic with high efficiency.

Key contributions

  • TwinGate is a stateful dual-encoder defense framework against LLM decompositional jailbreaks.
  • Utilizes Asymmetric Contrastive Learning (ACL) to cluster malicious fragments in a shared latent space.
  • Features a frozen encoder to suppress false positives from benign topical overlap efficiently.
  • Achieves high malicious intent recall and low false positive rates with minimal latency overhead.

Why it matters

Current LLM defenses struggle with decompositional jailbreaks in untraceable traffic due to context limitations and high overhead. TwinGate offers a stateful, efficient solution using asymmetric contrastive learning to detect fragmented malicious intent. This significantly enhances LLM security in real-world, anonymized deployments by providing robust, low-latency protection.

Original Abstract

Decompositional jailbreaks pose a critical threat to large language models (LLMs) by allowing adversaries to fragment a malicious objective into a sequence of individually benign queries that collectively reconstruct prohibited content. In real-world deployments, LLMs face a continuous, untraceable stream of fully anonymized and arbitrarily interleaved requests, infiltrated by covertly distributed adversarial queries. Under this rigorous threat model, state-of-the-art defensive strategies exhibit fundamental limitations. In the absence of trustworthy user metadata, they are incapable of tracking global historical contexts, while their deployment of generative models for real-time monitoring introduces computationally prohibitive overhead. To address this, we present TwinGate, a stateful dual-encoder defense framework. TwinGate employs Asymmetric Contrastive Learning (ACL) to cluster semantically disparate but intent-matched malicious fragments in a shared latent space, while a parallel frozen encoder suppresses false positives arising from benign topical overlap. Each request requires only a single lightweight forward pass, enabling the defense to execute in parallel with the target model's prefill phase at negligible latency overhead. To evaluate our approach and advance future research, we construct a comprehensive dataset of over 3.62 million instructions spanning 8,600 distinct malicious intents. Evaluated on this large-scale corpus under a strictly causal protocol, TwinGate achieves high malicious intent recall at a remarkably low false positive rate while remaining highly robust against adaptive attacks. Furthermore, our proposal substantially outperforms stateful and stateless baselines, delivering superior throughput and reduced latency.

📬 Weekly AI Paper Digest

Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.