Goodhart’s regulation famously says: “When a measure turns into a goal, it ceases to be a great measure.” Though initially from economics, it’s one thing now we have to grapple with at OpenAI when determining how you can optimize aims which are troublesome or expensive to measure.
Supply hyperlink
Measuring Goodhart’s regulation
