caa a22 4500 477092292 CHVBK 20180405111518.0 cr unu---uuuuu 170330e19960801xx s 000 0 eng 10.1007/BF02589173 doi (NATIONALLICENCE)springer-10.1007/BF02589173 López Carlos Centro de Cálculo, Facultad de Ingenìería Montevideo, Uruguay aut Improvements over the duplicate performance method for outlier detection in categorical multivariate surveys [Elektronische Daten] [Carlos López] Summary: The detection of errors and outliers is an important step in data processing, especially those errors arising from data entry operations because they are of the entire responsability of the data processing staff. The duplicate performance method, is commonly used as an attempt to detect such type of errors. It implies typically typing twice the same data without any special precedence. If the errors are uniformly distributed among individuals, retyping a fraction of the total will also remove typically the same fraction of the errors. A new method is presented, which is able to improve that procedure by sorting the records putting first the most unlikely ones. The ability of the present methodology has been tested by a Monte Carlo simulation, using an existing database of categorical answers of housing characteristics in Uruguay. At first, it has been randomly contaiminated, and after that, the proposed procedure applied. The results show that if a partial retyping is done following the proposed order about 50 % of the errors can be removed while keeping the retyping effort between 4 and 14% of the dataset, while to attain a similar result with the standard methodology 50% (on, average) of the database should be processed. The new ordering is based upon the unrotated Principal Component Analysis (PCA) transformation of the previously coded data. No special shape of the multivariate distribution function is assumed or required. Società Italiana di Statistica, 1996 Data checking nationallicence Census data management nationallicence Outlier detection nationallicence Principal Component analysis nationallicence Categorical data nationallicence Journal of the Italian Statistical Society Springer-Verlag 5/2(1996-08-01), 211-228 1121-9130 5:2<211 1996 5 10260 https://doi.org/10.1007/BF02589173 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/BF02589173 text/html Onlinezugriff via DOI NATIONALLICENCE 100 1- López Carlos Centro de Cálculo, Facultad de Ingenìería Montevideo, Uruguay aut NATIONALLICENCE 773 0- Journal of the Italian Statistical Society Springer-Verlag 5/2(1996-08-01), 211-228 1121-9130 5:2<211 1996 5 10260 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer