Back to Project
A

AgentBehaviorBench

Project Oct 18, 2026

DefuzeX's open-source harness for running agents in isolated cases, capturing execution evidence and evaluating behavioral defects.

Visit primary link 2 sources attached

What happened lately

AgentBehaviorBench timeline

AgentBehaviorBench is an MIT-licensed evaluation harness that separates an agent’s execution status from a judge’s assessment of its behavior. It records outputs, tool traffic and filesystem evidence while evaluation SDKs generate cases and judge the resulting traces.

Its documented setup uses a source checkout, Python 3.10 or newer and Docker for target-agent execution; Windows users run the Bash workflow in WSL. Official evaluations use the KUMA SDK and DefuzeX judging service with separate credentials from the target model and tools. The local SDK avoids KUMA credit, but model calls can still cost money. Its October 18 report describes manually reviewed findings, not a comparable performance ranking of every supported agent.