Pynguin: Automated Unit Test Generation for Python
By Stephan Lukasczyk, Gordon Fraser. 2022
164 citations recorded by the source corpus.
Automated unit test generation is a well-known methodology aiming to reduce the developers’ effort of writing tests manually. Prior research focused mainly on statically typed programming languages like Java. In practice, however, dynamically typed languages have received a huge gain in popularity over the last decade. This introduces the need for tools and research on test generation for these languages, too. We introduce Pynguin, an extendable testgeneration framework for Python, which generates regression tests with high code coverage. Pynguin is designed to be easily usable by practitioners; it is also extensible to allow researchers to adapt it for their needs and to enable future research. We provide a demo of Pynguin at https://youtu.be/UiGrG25Vts0; further information, documentation, the tool, and its source code are available at https://www.pynguin.eu.
Subfields: Information Systems, Software, Software Engineering
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Information Systems
In Software
Citations in the corpus
- Execution-Based Evaluation for Open-Domain Code Generation (2022, background): “Another thread of work attempts to generate test cases automatically based on the Python grammar (Lukasczyk and Fraser, 2022), but is largely limited to basic Python functions.”
- CodeT: Code Generation with Generated Tests (2022, background): “The later proposed Pyn-guin (Lukasczyk & Fraser, 2022) could handle dynamically typed language like Python.”
- Software Testing With Large Language Models: Survey, Landscape, and Vision (2023, unknown): “…Lemieux et al. [36] focus on a different direction, i.e., first letting the traditional search-based software testing techniques (e.g., Pynguin [135]) in generating unit test case until its coverage improvements stall, then asking the LLM to provide the example test cases for under-covered…”
- No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation (2023, background): “Although achieving reasonable coverage, these automatically-generated tests exhibit a large gap to manual-written ones in terms of readability and meaningfulness, and thus developers are mostly unwilling to directly adopt them in practice [15].”
- CodeARC: Benchmarking Reasoning Capabilities of LLM Agents for Inductive Program Synthesis (2025, unknown): “We use two state-of-the-art differential testing tools, P YNGUIN (Lukasczyk & Fraser, 2022) and M OKAV (Etemadi et al., 2024).”