Wolfram Ravenwolf demonstrated Wolfbench, an open source framework that measures AI agents across repeated runs instead of single scores. His benchmark data shows that higher reasoning effort and cheaper models often produce counterintuitive failures and massive token bills.
FireBrief
FireBrief