The Qualitas Corpus: A Curated Collection of Java Code for Empirical Studies
By E. Tempero, C. Anslow, Jens Dietrich, Ted Han, Jing Li, M. Lumpe, Hayden Melton, James Noble. 2010
440 citations recorded by the source corpus.
In order to increase our ability to use measurement to support software development practise we need to do more analysis of code. However, empirical studies of code are expensive and their results are difficult to compare. We describe the Qualitas Corpus, a large curated collection of open source Java systems. The corpus reduces the cost of performing large empirical studies of code and supports comparison of measurements of the same artifacts. We discuss its design, organisation, and issues associated with its development.
Subfields: Information Systems, Software, Evaluation & Benchmarks, Program Analysis & Verification
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Information Systems
- Miltiadis Allamanis
- Premkumar T. Devanbu
- Charles Sutton
- Sebastian Baltes
- Earl T. Barr
- Paul Ralph
- Mika V. Mäntylä
- Marco Zanoni
In Software
- Miltiadis Allamanis
- Premkumar T. Devanbu
- Charles Sutton
- Mika V. Mäntylä
- Marco Zanoni
- Francesca Arcelli Fontana
- Alessandro Marino
- Earl T. Barr
In Evaluation & Benchmarks
- Miltiadis Allamanis
- Mika V. Mäntylä
- Marco Zanoni
- Francesca Arcelli Fontana
- Premkumar T. Devanbu
- Alessandro Marino
- Charles Sutton
In Program Analysis & Verification
- Miltiadis Allamanis
- Premkumar T. Devanbu
- Charles Sutton
- Uri Alon
- Eran Yahav
- Earl T. Barr
- Marc Brockschmidt
- Prem Devanbu
Citations in the corpus
- The adverse effects of code duplication in machine learning models of code (2018, background): “The existence of duplicates was noticed much earlier [27] but their negative effect became significantly more noticeable due to recent advancements that allowed the collection of large code corpora [19].”
- New Initiative: The Naturalness of Software (2015, background): “The Qualitas [22] and Sourcerer [3] are both useful collections of curated source code.”
- Sampling in software engineering research: a critical review and guidelines (2020, background): “One way to achieve this is to develop curated corpora like the alitas corpus, “a large curated collection of open source Java systems” [50].”
- Comparing and experimenting machine learning techniques for code smell detection (2015, methodology): “A large set of object-oriented metrics, covering different aspects of software design, have been computed on a large repository of heterogeneous software systems (Tempero et al., 2010).”