AgentHarm turns agent misuse into a concrete safety benchmark

AgentHarm reframes safety testing around agents that use external tools and execute multi-stage tasks, rather than simple chatbot refusals. The benchmark includes 110 explicitly malicious agent tasks, expanded to 440 with augmentations, across 11 harm categories including fraud, cybercrime, and harassment. For agent builders, the signal is practical: safety evals need to test refusal, jailbreak resistance, and whether compromised agents still retain the planning and tool-use ability needed to complete harmful workflows.