Review of "Algorithms of oppression: how search engines reinforce racism," by Noble, S. U. (2018). New York, New York: NYU Press.
By G. Zobel. 2019
1,014 citations recorded by the source corpus.
Read and considered thoughtfully, Safiya Umoja Noble's Algorithms of Oppression: How Search Engines Reinforce Racism is devastating. It reduces to rubble the notion that technology is neutral and ideology-free. Noble's crushing the neutrality myth does several things. First, this act lays foundations for her argument: only if you recognize and understand that technology is built with, and integrates, bias, can you then be open to her primary thesis: search engines advance discriminatory and often racist content. Second, it banishes a convenient response for many self-identified meritocratic Silicon Valley "winners" and their supporters. Post-reading, some individuals may retain their beliefs in a neutral and ideology-free technology in spite of the overwhelming evidence and citations Noble brings to bear. Effective countering of Noble's claims is unlikely to occur. For professionals working in technology, information, argumentation, and/or rhetorical studies, Algorithms of Oppression is refreshing. Agonistic towards structural racism and its defenses, single-minded in its evidentiary presentation, collaborative in its acknowledgement of others' scholarship and research, Noble models many academic, critical, and social moves. Technology scholars and writers will find in Algorithms of Oppression a masterful mentor text on how to be an activist researcher scholar. Noble also makes this enjoyable reading. It is uncommon to find academic books that can simultaneously be read, used, and applied by academics and non-academics alike.
Subfields: Communication, AI Ethics, Fairness & Society, Social Sciences & Humanities
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Communication
- William S. Isaac
- L. Elisa Celis
- Huw Roberts
- Shakir Mohamed
- Nikita Aggarwal
- Hal Daumé Iii
- Alexandra To
- Jessica Morley
In AI Ethics, Fairness & Society
- Cynthia L. Bennett
- Inioluwa Deborah Raji
- William S. Isaac
- Morgan Klaus Scheuerman
- Miroslav Dud'ik
- L. Elisa Celis
- Huw Roberts
- Shakir Mohamed
In Social Sciences & Humanities
- Cynthia L. Bennett
- Inioluwa Deborah Raji
- William S. Isaac
- Stan Oklobdzija
- Emily Bello-Pardo
- Miroslav Dud'ik
- L. Elisa Celis
- Huw Roberts
Citations in the corpus
- Diagnosing Gender Bias in Image Recognition Systems (2020, background): “Because recent research suggests that GCV results may depend upon race and skin tone (Noble 2018), we control for race (coded as white or nonwhite).”
- Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need? (2018, background): “[43, 107], or a search engine that amplifies negative stereotypes by showing arrest-record ads in response to queries for names predominantly given to African American babies, but not for other names [12, 84]. Substantial effort in the rapidly growing research literature on fairness in ML has center”
- Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence (2020, background): “…exposes concerns of bias and injustice in algorithmic systems (Angwin et al. 2016a; Benjamin 2019; Buolamwini and Gebru 2018; Lum and Isaac 2016; Noble 2018; Eubanks 2018), exploitative or extractive data practices (Gray and Suri 2019), and applications of AI that dispossess the identity and…”
- Towards a critical race methodology in algorithmic fairness (2019, neutral): “[11, 20, 21, 24, 85]).”
- Racial categories in machine learning (2018, background): “[40], we argue that there is a substantive difference between systems that result in a controversial or unfair outcomes due to the racial bias of their designers and those that do so because they are”
- “It’s Complicated”: Negotiating Accessibility and (Mis)Representation in Image Descriptions of Race, Gender, and Disability (2021, background): “given increasing awareness of AI bias, but its history of misuse is characterized by secrecy and evading accountability [10, 80].”
- Terms of inclusion: Data, discourse, violence (2020, background): “Consequently, supposedly “objective” data can amplify, rather than ameliorate long-standing stereotypes of race and gender (Noble, 2018).”
- When data is capital: Datafication, accumulation, and extraction (2019, background): “2016), The Intersectional Internet (Noble and Tynes, 2016), Programmed Inequality (Hicks, 2017), Algorithms of Oppression (Noble, 2018), and Automating Inequality (Eubanks, 2018).”
- Handle with Care: Lessons for Data Science from Black Female Scholars (2020, background): “sexualized imagery of the Black Jezebel Whore in US media.(2) She discusses how Harvard Professor Latanya Sweeny’s discovery of the association of African Amer-”
- Bayesian Modeling of Intersectional Fairness: The Variance of Bias (2018, background): “With the rising influence of machine learning algorithms on many important aspects of our daily lives, there are growing concerns that biases inherent in data can lead the behavior of these algorithms to discriminate against certain populations [1, 3, 5, 6, 11, 22, 23].”
- The ethics of algorithms: key problems and solutions (2020, background): “…systems has demonstrated the limits of this approach highlighting, among other things, that long-standing structural inequalities are often deeply embedded in the algorithms’ datasets and are rarely, if ever, corrected for (Hu 2017; Turner Lee 2018; Noble 2018; Benjamin 2019; Richardson et al.”
- Implicit Diversity in Image Summarization (2019, background): “Such biases extend beyond images and beyond occupations; Noble [66] highlights the inherent social biases against marginalized populations in other kinds of search results.”
- Data Epistemologies, The Coloniality of Power, and Resistance (2019, background): “New attention is needed to considering the risks of mathsplaining (O’Neil 2016) and the profound impact of data on reproducing discrimination (O’Neil 2016), poverty (Eubanks 2018), and social oppression (Noble 2018) beyond borders.”
- Back to the Future: Achieving Health Equity Through Health Informatics and Digital Health (2019, background): “Moreover, racial and ethnic minority groups have been historically faced with negative stereotyping bias [73-76] and unjust criminal sentences [77,78], which unfortunately have been recently promulgated through present-day data discrimination via search engines [79] and machine learning algorithms [”