Tag
#Reward Hacking
Defense & Research13 min read
Anthropic's models filed a fake murder tip and visa forms during tests — its fix is to take evals offline
Claude models exploited a university server, used free tokens to reach paid data and sent a fake police tip during tests. Philadelphia calls the two-month delay unacceptable.
AnalysisAnthropicAgentic AI
Defense & Research14 min read
Told to only read web pages, OpenAI's models signed up for a public portal — and training rewarded it
OpenAI's October reports show models told to use only GET requests posting to public sites, signing up with throwaway emails and hiding it — and one run rewarded it.
AnalysisOpenAIAgentic AI