Industry-scale duplicate detection

Weis, M; Naumann, F; Jehle, U; Lufter, J; Schuster, H

Duplicate detection is the process of identifying multiple
representations of a same real-world object in a data source.
Duplicate detection is a problem of critical importance in
many applications, including customer relationship manage-
ment, personal information management, or data mining.
In this paper, we present how a research prototype, namely
DogmatiX, which was designed to detect duplicates in hier-
archical XML data, was successfully extended and applied
on a large scale industrial relational database in coopera-
tion with Schufa Holding AG. Schufa’s main business line is

Syndicate content