What is reward hacking?

A pattern where an AI model gets rewarded for reaching a goal through some unintended shortcut, so that shortcut gets reinforced instead of corrected. A habit picked up this way during training can later show up as problem behavior in real use.

Briefings mentioning this
2026-08-272026-08-192026-08-082026-08-04

Terms seen alongside this one