Executive Summary: Detecting Strategic Deception in Japanese LLMs

Author: Kazuki Kimura (Ex-AISI International Coordinator, AI Safety Field Builder)

Github: https://github.com/kirby44/deception-detection

AI models may use deceptive strategies as part of scheming or misaligned behavior.
Monitoring outputs alone(black-box approach) is insufficient.
This work shows simple linear probe distinguishes honest and deceptive responses.
We extend this work to Japanese models and datasets.
We observed that performance degraded significantly when applied to Japanese models.

Project