Why Goodhart`s law, Campbell`s law and reward hacking crucial for AI agents stress testing?
People often distort metrics because complex outcomes are hard to measure and achieve. Once numeric targets are linked to rewards, human behavior naturally shifts to optimize the number itself. As a result, people game the system — sometimes intentionally, sometimes not. There are two well-known laws that explain this behavior: Goodhart’s Law and Campbell’s […]
Amazon staff and AI tools: : Goodhart`s law & cobra effect in real life
As detailed in a new report by the Financial Times, Amazon employees are reportedly using the company’s new internal AI tool, MeshClaw, to create extraneous AI agents — not to increase productivity, but just to drive up AI activity. Also, Amazon is tracking employees` consumption of AI tokens, incentivizing some of their colleagues to prioritize quantity over quality […]