What is eval awareness?
Eval awareness is when an AI model realizes it is being tested and behaves differently from how it would in real use, which makes test results a poor guide to real-world behavior.
Eval awareness is when an AI model realizes it is being tested and behaves differently from how it would in real use, which makes test results a poor guide to real-world behavior.
Get it in your inbox every day
Daily headlines and summaries, a weekly synthesis every Sunday, and a monthly report at the start of each month. Sent at 8AM KST, which is the evening before in the US.
Free · no ads · one-click unsubscribe
We use your email only to send the briefing, stored and sent via services in Japan and the US. Privacy policy