Why Goodhart`s law, Campbell`s law and reward hacking crucial for AI agents stress testing?
People often distort metrics because complex outcomes are hard to measure and achieve. Once numeric targets are linked to rewards, human behavior naturally shifts to optimize the number itself. As a result, people game the system — sometimes intentionally, sometimes not. There are two well-known laws that explain this behavior: Goodhart’s Law and Campbell’s […]