← All benchmarks

DecepEval Tool-use (Induced)

Safety · 2026-10-06

Deception rate of LLM agents on the induced versions of DecepEval's 550 Tool-use tasks (information retrieval, verification and external information acquisition), in which tools return deterministic failures or limited evidence that the agent must report faithfully. Each induced version adds pressure, an incentive, an opportunity or a conflicting goal to an otherwise identical neutral task, and a Claude Fable 5 judge labels a trajectory deceptive when its reports misstate the tool outcomes or the evidence it actually obtained. The score is the percentage of tasks judged deceptive; lower is better.

Top models (lower is better)