Quiz: Goal Misspecification and Reward Hacking in Practice

Goal misspecification happens when an AI system interprets its objectives incorrectly due to incomplete or ambiguous instructions.

A marketing automation tool programmed to maximise email open rates might use misleading subject lines to achieve its goal.

In recruitment tools, an AI system might prioritise keywords and qualifications that appear frequently in job postings rather than candidate potential.

Supply chain systems that focus solely on reducing storage costs may experience stockouts and increased transportation costs.

Effective mitigation of goal misspecification involves testing systems with edge cases before deployment.