ReTokSync: Self-Synchronizing Tokenization Disambiguation for Generative Linguistic Steganography
Yaofei Wang, Rui Wang, Weilong Pang, JiaLiang Han, Yuan Qi + 2 more
TLDR
ReTokSync is a self-synchronizing framework that resolves tokenization ambiguity in generative linguistic steganography, achieving high extraction accuracy with minimal overhead.
Key contributions
- Introduces ReTokSync, a self-synchronizing framework to resolve tokenization ambiguity in generative linguistic steganography.
- Monitors receiver tokenization, correcting only when needed to prevent global desynchronization.
- Achieves over 99.7% extraction accuracy while maintaining distributional security and text quality.
- Enables 100% end-to-end recovery using a two-channel communication mechanism.
Why it matters
Generative linguistic steganography is vulnerable to tokenization ambiguity, which can break covert communication. Existing solutions compromise security or efficiency. ReTokSync provides a practical, robust method to overcome this, ensuring reliable and secure hidden message extraction.
Original Abstract
Generative linguistic steganography (GLS) enables covert communication by embedding secret messages into the natural language generation process. In practical deployment, however, GLS is vulnerable to tokenization ambiguity: the same surface text may be re-tokenized into a different token sequence at the receiver, breaking the shared decoding state between the communicating parties so that a single local mismatch can propagate into complete extraction failure. Existing solutions either remove ambiguous tokens -- distorting the generation distribution and compromising security -- or preserve the distribution at the cost of substantially reduced embedding capacity or prohibitive runtime overhead. To address this issue, we propose ReTokSync (Re-Tokenization Synchronization), a self-synchronizing disambiguation framework that monitors the receiver-view tokenization during generation and triggers a corrective reset only when ambiguity actually occurs. By confining the effect of tokenization ambiguity to sparse residual bit errors rather than global desynchronization, ReTokSync leaves ambiguity-free positions entirely untouched and remains compatible with the underlying steganographic algorithm. Experiments on both English and Chinese settings show that ReTokSync stays closest to the steganographic baseline in distributional security (zero KL divergence), text quality, embedding capacity, and runtime, while achieving extraction accuracy above 99.7\%. Building on this property, we further develop a two-channel covert communication mechanism in which ReTokSync serves as the primary channel and a reliable auxiliary channel corrects the remaining errors, achieving 100\% end-to-end recovery across all evaluated configurations.
📬 Weekly AI Paper Digest
Get the top 10 AI/ML arXiv papers from the week — summarized, scored, and delivered to your inbox every Monday.