Experimental evidence on the productivity effects of generative artificial intelligence
By Shakked Noy, Whitney Zhang. 2023
1,457 citations recorded by the source corpus.
We examined the productivity effects of a generative artificial intelligence (AI) technology, the assistive chatbot ChatGPT, in the context of midlevel professional writing tasks. In a preregistered online experiment, we assigned occupation-specific, incentivized writing tasks to 453 college-educated professionals and randomly exposed half of them to ChatGPT. Our results show that ChatGPT substantially raised productivity: The average time taken decreased by 40% and output quality rose by 18%. Inequality between workers decreased, and concern and excitement about AI temporarily rose. Workers exposed to ChatGPT during the experiment were 2 times as likely to report using it in their real job 2 weeks after the experiment and 1.6 times as likely 2 months after the experiment. Description Editor’s summary Automation has historically displaced human workers in factories (e.g., automotive manufacturing) or in performing routine computational tasks. Will generative artificial intelligence (AI) tools such as ChatGPT disrupt the labor market by making educated professionals obsolete, or will these tools complement their skills and enhance productivity? Noy and Zhang examined this issue in an experiment that recruited college-educated professionals to complete incentivized writing tasks. Participants assigned to use ChatGPT were more productive, efficient, and enjoyed the tasks more. Participants with weaker skills benefited the most from ChatGPT, which carries policy implications for efforts to reduce productivity inequality through AI. —EEU The assistive chatbot ChatGPT raises productivity in professional writing tasks and reduces productivity inequality.
Subfields: Demography, Health Informatics, Sociology and Political Science, AI Ethics, Fairness & Society, Economics & Operations Research
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Demography
- Daniel Rock
- Dmitry A. Ivanov
- Pamela Mishkin
- Tyna Eloundou
- Ilya Jackson
- Anil R. Doshi
- Oliver P. Hauser
- Jafar Namdar
In Health Informatics
In Sociology and Political Science
- Daniel Rock
- Dmitry A. Ivanov
- Pamela Mishkin
- Tyna Eloundou
- Ilya Jackson
- Anil R. Doshi
- Oliver P. Hauser
- Jafar Namdar
In AI Ethics, Fairness & Society
- Daniel Rock
- Dmitry A. Ivanov
- Pamela Mishkin
- Tyna Eloundou
- Ilya Jackson
- Anil R. Doshi
- Oliver P. Hauser
- Jafar Namdar
In Economics & Operations Research
- Tyna Eloundou
- Pamela Mishkin
- Sam Manning
- Daniel Rock
- Dmitry A. Ivanov
- Ilya Jackson
- Anil R. Doshi
- Oliver P. Hauser
Citations in the corpus
- GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models (2023, background): “There is also a growing set of studies examining specific economic impacts and opportunities for LLMs (Bommasani et al., 2021; Felten et al., 2023; Korinek, 2023; Mollick and Mollick, 2022; Noy and Zhang, 2023; Peng et al., 2023).”
- Can large language models provide useful feedback on research papers? A large-scale empirical analysis (2023, background): “Researchers have discussed the potential of LLM to improve productivity 47,48 , creativity 49 , and facilitate scientific discovery 50 .”
- Generative AI enhances individual creativity but reduces the collective diversity of novel content (2023, positive): “That generative AI particularly benefited less able writers is paralleled in recent studies focusing on other domains in which generative AI has been shown to help less productive workers ( 4 , 5 ).”
- When combinations of humans and AI are useful: A systematic review and meta-analysis (2024, neutral): “Furthermore, the relatively little work that does evaluate human–AI collaboration according to quantitative performance metrics tends to report only the performance of the human alone and that of the human–AI combination (not the AI alone) 52 .”
- Generative artificial intelligence in supply chain and operations management: a capability-based framework for analysis and implementation (2024, positive): “For instance, a study by Noy and Zhang (2023) illustrated that ChatGPT notably boosts worker productivity for midlevel professional writing tasks.”