‘Improving ratings’: audit in the British University system

By M. Strathern. 1997

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Social Sciences & Humanities

Citations in the corpus

Measurement and Fairness (2019, background): “, a predictive policing algorithm sends more police to an already over-policed neighborhood [43]); or shifting incentives (sometimes expressed as Goodhart’s Law: “when a measure becomes a target, it ceases to be a good measure” [61, 31]).”
Alignment of Language Agents (2021, background): “Originally introduced in the context of economics, Goodhart’s Law (Goodhart, 1984; Strathern, 1997) states that: When a measure becomes a target, it ceases to be a good measure.”
Unsolved Problems in ML Safety (2021, background): “Since proxies “will tend to collapse once pressure is placed upon” them by optimizers [64, 127, 169], proxies can often be gamed.”
The Audit Society — Second Thoughts (2000, background): “There is an extensive literature which questions whether organizations do or could ever function according to the formal self-transparency and vigilance required of figure 1 and its real world instantiations (such as ISO 9000 and its variants) (See Strathern, 1997).”
The New C Standard (Excerpted material) An Economic and Cultural Commentary (2008, unknown): “” Strathern[434] describes how the use of a rating system changed the nature of university research and teaching.”
Assessment relationships in higher education: the tension of process and practice (2006, background): “Indeed, it is critiques of institutional responses to audit (Power, 1997 ; Strathern, 1997 , 2000 ) that furnish an educational echo to Brown and Duguid's ( 2000 ) concerns over the process/practice tension in organisational life.”
How to Design AI for Social Good: Seven Essential Factors (2020, background): “Well-established findings such as Goodhart’s Law (Goodhart 1975), which is often summarised as “when a measure becomes a target, it ceases to be a good measure” (Strathern 1997, 308), long pre-date widespread adoption of AI systems.”
The Social Cost of Strategic Classification (2018, background): “This widely observed empirical phenomenon, known as Campbell’s Law or Goodhart’s Law, is often summarized as: “Once a measure becomes a target, it ceases to be a good measure” [26].”
Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback (2023, background): “Goodhart’s Law1 (Strathern, 1997) can be formulated a tough challenge in numerous fields.”
Publishing in accounting journals: A fair game? (2009, unknown): “(Strathern, 1997).”
Rankings and Reactivity: How Public Measures Recreate Social Worlds1 (2007, unknown): “In Great Britain assessment exercises initiated during the 1980s have reorganized higher education, dictating budgets and hiring, reinventing schools as “ﬁnancial bodies,” and generating a “whole host of new institutions and practices” (Strathern 1997, p. 309; Shore and Wright 2000, p. 61).”
The Problem with Metrics is a Fundamental Problem for AI (2020, unknown): “In his entry on Goodhart’s Law in The Encyclopedia of Central Banking (Goodhart 2015), Goodhart refers to the popular phrasing of his namesake law, “When a measure becomes a target, it ceases to be a good measure” (Strathern 1997).”
Reward (Mis)design for Autonomous Driving (2021, unknown): “[42, 16].”