Goodhart’s law famously says: “When a measure becomes a goal, it ceases to be a superb measure.” Although originally from economics, it’s something now we have to grapple with at OpenAI when determining the best way to optimize objectives which can be difficult or costly to measure.