The Impact of AI on Developer Productivity: Evidence from GitHub Copilot

By Sida Peng, Eirini Kalliamvakou, Peter Cihon, Mert Demirer. 2023

697 citations recorded by the source corpus.

Generative AI tools hold promise to increase human productivity. This paper presents results from a controlled experiment with GitHub Copilot, an AI pair programmer. Recruited software developers were asked to implement an HTTP server in JavaScript as quickly as possible. The treatment group, with access to the AI pair programmer, completed the task 55.8% faster than the control group. Observed heterogenous effects show promise for AI pair programmers to help people transition into software development careers.

Subfields: Computer Science Applications, Information Systems, Evaluation & Benchmarks, Code Generation & Program Synthesis, Software Engineering

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Science Applications

  1. Paul Denny
  2. Juho Leinonen
  3. Arto Hellas
  4. Sami Sarsa
  5. Andrew Luxton-Reilly
  6. James Prather
  7. Brett A. Becker
  8. Daniel Rock

In Information Systems

  1. Paul Denny
  2. Juho Leinonen
  3. Arto Hellas
  4. Sami Sarsa
  5. Shin Yoo
  6. Mark Harman
  7. Andrew Luxton-Reilly
  8. James Prather

In Evaluation & Benchmarks

  1. Juho Leinonen
  2. Paul Denny
  3. Daniel Rock
  4. James Prather
  5. Brett A. Becker
  6. Mark Harman
  7. Sami Sarsa
  8. Arto Hellas

In Code Generation & Program Synthesis

  1. Paul Denny
  2. Juho Leinonen
  3. Sami Sarsa
  4. Arto Hellas
  5. Mark Harman

In Software Engineering

  1. Juho Leinonen
  2. Arto Hellas
  3. Mark Harman

Citations in the corpus