Specification Gaming Advanced

Specification Gaming

Advanced

Model exploits poorly specified objectives.

AdvertisementAd space — term-top

Definition

Full Definition

Model exploits poorly specified objectives.

Keywords

reward hacking

Domains

AI Safety & Alignment

Related Terms

Reward Hacking related to

Maximizing reward without fulfilling real goal.

 Instrumental Convergence related to

Tendency for agents to pursue resources regardless of final goal.

 Value Misalignment related to

Model optimizes objectives misaligned with human values.

 Outer Alignment related to

Correctly specifying goals.

 Alignment Problem related to

Ensuring AI systems pursue intended human goals.

Welcome to AI Glossary

The free, self-building AI dictionary. Help us keep it free—click an ad once in a while!

Search

Type any question or keyword into the search bar at the top.

Browse

Tap a letter in the A–Z bar to browse terms alphabetically, or filter by domain, industry, or difficulty level.

3D WordGraph

Fly around the interactive 3D graph to explore how AI concepts connect. Click any word to read its full definition.