The Evolution of Evaluation to Fit an Imperfect World
Seminar | November 30 | 250 Sutardja Dai Hall
The evolution of data accumulation, management, analytics, and visualization has led to the coining of the term big data, which challenges the task of data integration. This task, common to any matching problem in computer science involves generating alignments between structured data in an automated fashion. Historically, set-based measures, based upon binary similarity matrices (match/non-match), have dominated evaluation practices of matching tasks. However, in the presence of big data, such measures no longer suffice. In this talk, we propose an approach that makes use of non-binary evaluation and demonstrate its usefulness in several problem domains.