Evaluation & Benchmarks

Benchmarks, datasets, evaluation metrics and methodology.

A topic in the Science corpus, drawn from 2,639 papers.

Trusted voices in Evaluation & Benchmarks

Ordered by the trust Evaluation & Benchmarks's own network concentrates on each researcher, most first.

  1. Chih-Jen Lin — trusted by 2,293 researchers here
  2. Chin-Yew Lin — trusted by 1,898 researchers here
  3. Hirotugu Akaike — trusted by 1,652 researchers here
  4. Leo Breiman — trusted by 1,226 researchers here
  5. Li Fei-Fei — trusted by 1,620 researchers here
  6. Jia Deng — trusted by 1,463 researchers here
  7. Samuel R. Bowman — trusted by 1,030 researchers here
  8. Pietro Perona — trusted by 1,086 researchers here
  9. David Ruppert — trusted by 857 researchers here
  10. Li-Jia Li — trusted by 1,084 researchers here
  11. Richard Socher — trusted by 1,079 researchers here
  12. Salim Roukos — trusted by 971 researchers here

Most-cited papers in Evaluation & Benchmarks

Ordered by the recorded citation count from the source corpus; a citation is not an endorsement.

  1. Scikit-learn: Machine Learning in Python (2011) — 91,720 citations
  2. Et al (2008) — 75,403 citations
  3. ImageNet: A large-scale hierarchical image database (2009) — 74,730 citations
  4. Image quality assessment: from error visibility to structural similarity (2004) — 58,269 citations
  5. Microsoft COCO: Common Objects in Context (2014) — 54,126 citations
  6. A fast and elitist multiobjective genetic algorithm: NSGA-II (2002) — 48,475 citations
  7. LIBSVM: A library for support vector machines (2011) — 44,984 citations
  8. ImageNet Large Scale Visual Recognition Challenge (2014) — 43,116 citations
  9. Bleu: a Method for Automatic Evaluation of Machine Translation (2002) — 33,928 citations
  10. SciPy 1.0: fundamental algorithms for scientific computing in Python (2019) — 33,467 citations
  11. An introduction to ROC analysis (2006) — 21,593 citations
  12. ROUGE: A Package for Automatic Evaluation of Summaries (2004) — 21,161 citations
  13. The WEKA data mining software: an update (2009) — 20,738 citations
  14. Classification and Regression by randomForest (2007) — 19,523 citations
  15. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric (2018) — 18,743 citations
  16. The Elements of Statistical Learning: Data Mining, Inference, and Prediction (2004) — 18,671 citations
  17. What is a systematic review? (2011) — 17,419 citations
  18. Interrater reliability: the kappa statistic (2012) — 16,963 citations
  19. A global reference for human genetic variation (2015) — 16,925 citations
  20. An Introduction to Variable and Feature Selection (2003) — 16,826 citations
  21. Are we ready for autonomous driving? The KITTI vision benchmark suite (2012) — 15,381 citations
  22. The Cityscapes Dataset for Semantic Urban Scene Understanding (2016) — 13,806 citations
  23. Statistical Comparisons of Classifiers over Multiple Data Sets (2006) — 13,306 citations
  24. Handbook of Applied Cryptography (2018) — 12,896 citations
  25. pROC: an open-source package for R and S+ to analyze and compare ROC curves (2011) — 12,241 citations
  26. A Comprehensive Survey on Graph Neural Networks (2019) — 11,551 citations
  27. Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms (2017) — 10,881 citations
  28. Astropy: A community Python package for astronomy (2013) — 10,756 citations
  29. Evaluating Large Language Models Trained on Code (2021, arXiv.org) — 10,663 citations
  30. Vision meets robotics: The KITTI dataset (2013) — 10,594 citations
  31. The human genome browser at UCSC. (2002) — 10,522 citations
  32. A general and simple method for obtaining R2 from generalized linear mixed‐effects models (2013) — 9,998 citations
  33. Judging LLM-as-a-judge with MT-Bench and Chatbot Arena (2023) — 9,887 citations
  34. SQuAD: 100,000+ Questions for Machine Comprehension of Text (2016) — 9,586 citations
  35. BERTScore: Evaluating Text Generation with BERT (2019) — 9,100 citations
  36. Measuring Massive Multitask Language Understanding (2020) — 8,927 citations
  37. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics (2001) — 8,885 citations
  38. MIMIC-III, a freely accessible critical care database (2016) — 8,772 citations
  39. GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding (2018) — 8,768 citations
  40. nuScenes: A Multimodal Dataset for Autonomous Driving (2019) — 8,536 citations
  41. LIBLINEAR: A Library for Large Linear Classification (2008) — 8,472 citations
  42. METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments (2005) — 8,297 citations
  43. Librispeech: An ASR corpus based on public domain audio books (2015) — 8,192 citations
  44. A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms (2001) — 8,091 citations
  45. Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles (2016) — 8,039 citations
  46. Data Analysis Using Regression and Multilevel/Hierarchical Models (2009) — 7,733 citations
  47. The mnist database of handwritten digits (2005) — 7,477 citations
  48. The CMS experiment at the CERN LHC (2008) — 7,266 citations
  49. UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild (2012) — 7,255 citations
  50. CARLA: An Open Urban Driving Simulator (2017) — 6,955 citations

Most active researchers

By papers in this topic: a volume measure, not trust.