Duplicate Record Detection: A Survey

By Ahmed K. Elmagarmid, Panagiotis G. Ipeirotis, Vassilios S. Verykios. IEEE Transactions on Knowledge and Data Engineering, 2007

2,251 citations recorded by the source corpus.

View Paper: https://www.semanticscholar.org/paper/213cb7593934bc675c336f53dd6c61a3c799be80

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

Citations in the corpus

Efficient similarity joins for near duplicate detection (2008, background): “[12] is a recent survey on this topic.”
LINDA: distributed web-of-data-scale entity matching (2012, background): “Classical record linkage typically relies on similarity measures between strings and between records [8, 1].”
Data Integration: The Current Status and the Way Forward (2018, background): “This step is crucial in enabling comparing records across sources; (e) Deduplication and record linkage tools [4, 7, 10] are used to cluster records.”
Crowdsourced Data Management: Industry and Academic Perspectives (2015, background): “Entity Resolution, or deduplication [78] refers to the problem of identifying if two textual records refer to the same entity.”
Research directions in data wrangling: Visualizations and transformations for usable and credible data (2011, unknown): “2011–6:17pm] [1–18] K:/IVI/IVI 415994.”
Trends in Cleaning Relational Data: Consistency and Deduplication (2015, methodology): “The techniques for designing a classifier can be broadly categorized into supervised learning techniques, semi-supervised or active learning techniques, and unsupervised techniques [40].”
A sample-and-clean framework for fast and accurate query processing on dirty data (2014, background): “This problem has been extensively studied for several decades [22].”
Systematic review automation technologies (2014, background): “Current systems Current technologies focus on citation de-duplication [80].”
Data Curation at Scale: The Data Tamer System (2013, background): “For example, one web aggregator requires the curation of 80,000 URLs and a second biotech company has the problem of curating 8000 spreadsheets.”
Learning Semantic String Transformations from Examples (2012, background): “Most of the prior work in this area [5, 12] has focused on designing appropriate similarity functions such as edit distance, jaccard similarity, cosine similarity, and HMM25.”
Mastering the Information Age - Solving Problems with Visual Analytics (2010, background): “One of the first problems of this kind was the presence of duplicated records of a person[43], and the devised practical and theoretical solution, called record linkage, allowed the collection and linkage of all the related data records, producing a unique and consistent view of the person.”
Entity Linking: Finding Extracted Entities in a Knowledge Base (2013, background): “For a comprehensive survey on string similarity metrics for duplicate names, we refer the reader to [14].”
An Introduction to Duplicate Detection (2010, methodology): “While this lecture is intended to serve as an overview and primer for the field of duplicate detection, we refer interested readers to a recent and more comprehensive literature survey by Elmagarmid et al. [2007].”
PyPSA-Eur: An open optimisation model of the European transmission system (2018, methodology): “JaroToken breaks the full string into several tokens, evaluates the Jaro Winkler distance metric for each and returns the compound Jaccard index [36].”
Don't be SCAREd: use SCalable Automatic REpairing with maximal likelihood and bounded changes (2013, methodology): “Statistical machine learning techniques for data cleaning: Data cleaning using ML techniques mainly focused on deduplication (refer to [6] for survey), data imputation (e.”
LIMES - A Time-Efficient Approach for Large-Scale Link Discovery on the Web of Data (2011, background): “The task of discovering links between knowledge bases is closely related with record linkage [22, 9] and de-duplication [7].”
A Survey of Link Prediction in Social Networks (2011, methodology): “For instance, in bibliography and library science, it can be used for de-duplication [39] and record linkage [4]; in Bioinformatics, it has been used in protein-protein interaction (PPI) prediction [6] or to annotate the PPI graph [18].”
Improving the Study of Campaign Contributors with Record Linkage (2010, background): “Excellent recent overviews of techniques and research issues relevant to record linkage in general have been compiled by Gu et al. (2003), Winkler (2006), and Elmagarmid et al. (2007).”
Privacy preserving schema and data matching (2007, background): “The record matching problem (also known as record linkage) has been studied for more than five decades (see the recent survey [12]).”
Big data integration (2013, background): “Record linkage refers to the task of identifying records that refer to the same logical entity across different data sources, especially when they may or may not share a common identifier across the data sources [24], [19], [30], [46], [14].”