https://david-vazquez.com/tags/benchmarks/BenchmarksHugo Blox Builder (https://hugoblox.com)en-usTue, 01 Apr 2025 00:00:00 +0000https://david-vazquez.com/media/icon_hu_a3642885bc94ba2d.pnghttps://david-vazquez.com/tags/benchmarks/https://david-vazquez.com/project/enterpriseops-gym/Tue, 01 Apr 2025 00:00:00 +0000https://david-vazquez.com/project/enterpriseops-gym/<p>EnterpriseOps-Gym features 1,150 expert designed tasks across 8 interconnected enterprise domains, with persistent state, strict verification logic, and policy aware execution requirements. It tests whether AI agents can handle domain expertise, not just general reasoning.</p>https://david-vazquez.com/project/workarena/Mon, 01 Jul 2024 00:00:00 +0000https://david-vazquez.com/project/workarena/<p>WorkArena is a benchmark of tasks based on the ServiceNow platform that measures how well web agents can perform common knowledge work. BrowserGym provides a rich environment for designing and evaluating such agents with multimodal observations and a comprehensive action set. Published at ICML 2024.</p>