Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups
By Anthony F. J. van Raan. Scientometrics, 2005
437 citations recorded by the source corpus.
In this paper we present characteristics of the statistical correlation between the Hirsch (h-) index and several standard bibliometric indicators, as well as with the results of peer review judgment. We use the results of a large evaluation study of 147 university chemistry research groups in the Netherlands covering the work of about 700 senior researchers during the period 1991–2000. Thus, we deal with research groups rather than individual scientists, as we consider the research group as the most important work floor unit in research, particularly in the natural sciences. Furthermore, we restrict the citation period to a three-year window instead of ‘life time counts’ in order to focus on the impact of recent work and thus on current research performance. Results show that the h-index and our bibliometric ‘crown indicator’ both relate in a quite comparable way with peer judgments. But for smaller groups in fields with ‘less heavy citation traffic’ the crown indicator appears to be a more appropriate measure of research performance.
Subfields: Information Systems, Statistics and Probability, Strategy and Management
View Paper: https://www.semanticscholar.org/paper/d48f865cae86342b4ffdb820f6c57fdf0a3f9b32
How researchers see this paper
The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.
In Information Systems
- Ludo Waltman
- Nees Jan van Eck
- Loet Leydesdorff
- John C. Mingers
- John S. Liu
- Paul F. Wouters
- Ming-Huang Wang
- Louis Y. Y. Lu
In Statistics and Probability
- Ludo Waltman
- Paul F. Wouters
- L. Langfeldt
- Nees Jan van Eck
- Dag W. Aksnes
- Loet Leydesdorff
- John C. Mingers
- John S. Liu
In Strategy and Management
- John S. Liu
- Paul F. Wouters
- Loet Leydesdorff
- Ludo Waltman
- John C. Mingers
- Ming-Huang Wang
- Louis Y. Y. Lu
- Hui-Zhen Fu
Citations in the corpus
- An integrated approach for main path analysis: Development of the Hirsch index as an example (2012, background): “The largest traversal count among all routes leading to BraunGS2006 is from BatistaCKM2006 (Batista et al., 2006) at 15,350; yet, the largest traversal count among all routes leading to EggheR2006 is 33,286 from Vanraan2006 (van Raan, 2006).”
- The inconsistency of the h-index (2011, background): “A large part of the literature building on Hirsch’ work is concerned with introducing variants, extensions, and generalizations of the h-index.”
- Citations, Citation Indicators, and Research Quality: An Overview of Basic Concepts and Theories (2019, methodology): “Other examples include van Raan (2006) who analyzed the correlation between the h-index and several standard bibliometric indicators with the results of peerreview judgment for research groups within chemistry in the Netherlands.”
- A review of theory and practice in scientometrics (2015, methodology): “In contrast, bibliometrics has the potential to provide a cheaper, more objective and more informative mode of analysis, although there is general agreement that bibliometrics should only be used in combination with some form of transparent peer review Moed (2007; van Raan, 2005b).”
- COMPARISON OF UNIVERSITIES SCIENTIFIC PERFORMANCE USING BIBLIOMETRIC INDICATORS (2011, methodology): “The h-index has been used for evolution of research groups (Van Raan 2006), institutions (Molinari and Molinari, 2008), individual researchers (Cronin and Meho 2006), and journals (Vanclay 2008).”