Tencent has unveiled WorkBuddy Bench, a novel multi-domain evaluation suite designed to assess coding agents across four distinct work domains: Code, Web, Office, and Security. The benchmark aims to provide a more realistic and contamination-resistant assessment of agent capabilities.
Unlike traditional benchmarks that adapt public issue text, WorkBuddy Bench constructs each task by reverse-engineering real commits, pull requests, or business scenarios. These are rewritten as short, colloquial, role-played requests, ensuring that the task prompt cannot be recovered by searching the original issue online. This approach, combined with dataset versioning, provides contamination resistance without relying on secrecy.
The benchmark is fully open-source, releasing task directories, environment images, evaluation harnesses, tests, and reference solutions. This allows third parties to re-run each task and inspect its content, ensuring reproducibility and auditability. All tasks are packaged in a uniform directory format and run under a reproducible protocol on two agent harnesses: CodeBuddy Code and Claude Code.
The four subsets probe complementary facets of real work: repository-level engineering, front-end development, office and business workflows, and red-/blue-team security. Each subset uses a different scoring instrument, so scores are not comparable across subsets, and the suite reports no overall average. A cross-model leaderboard across several model families is provided.