Framework for Evaluating Clustering Algorithms in Duplicate Detection

Hassanzadeh, Oktie; Chiang, Fei; Miller, Renée; Lee, Hyun Chul

The presence of duplicate records is a major data quality concern in
large databases. To detect duplicates, entity resolution also known
as duplication detection or record linkage is used as a part of the
data cleaning process to identify records that potentially refer to
the same real-world entity. We present the Stringer system that
provides an evaluation framework for understanding what barriers
remain towards the goal of truly scalable and general purpose duplication
detection algorithms. In this paper, we use Stringer to

Syndicate content