INFORMATION

Psicothema was founded in Asturias (northern Spain) in 1989, and is published jointly by the Psychology Faculty of the University of Oviedo and the Psychological Association of the Principality of Asturias (Colegio Oficial de Psicología del Principado de Asturias).
We currently publish four issues per year, which accounts for some 100 articles annually. We admit work from both the basic and applied research fields, and from all areas of Psychology, all manuscripts being anonymously reviewed prior to publication.

PSICOTHEMA
  • Director: Laura E. Gómez Sánchez
  • Frequency:
         February | May | August | November
  • ISSN: 0214-9915
  • Digital Edition:: 1886-144X
CONTACT US
  • Address: Ildelfonso Sánchez del Río, 4, 1º B
    33001 Oviedo (Spain)
  • Phone: 985 285 778
  • Fax: 985 281 374
  • Email:psicothema@cop.es

Psicothema, 2012. Vol. Vol. 24 (nº 1). 133-141




Procedimientos para realizar meta-análisis de la precisión de instrumentos de clasificación binaria

Juan Botella y Huiling Huang

Universidad Autónoma de Madrid

La evaluación de la precisión en la clasificación binaria debe contemplar dos indicadores no independientes: verdaderos positivos y falsos positivos. Se han propuesto varios índices. Estos han sido estimados en algunos tests para la detección temprana o cribaje. Resumimos y revisamos los principales métodos propuestos para realizar meta-análisis que evalúan la precisión de este tipo de instrumentos. Se aplican a los resultados de 14 estudios que informan de estimaciones de la precisión del test AUDIT. La agregación directa no permite el uso de los procedimientos meta-analíticos; la estimación separada de la sensibilidad y la especificidad no reconoce que no son independientes; el método de la curva ROC-resumen trata la precisión y el umbral como factores fijos y tiene limitaciones para manejar el papel potencial de las covariables. Los modelos Normal Bivariado y Jerárquico de la curva ROC Resumen son estadísticamente rigurosos y son capaces de incorporar las covariables adecuadamente. Ambos métodos permitieron analizar la asociación entre el género de la muestra y el comportamiento del AUDIT.

Procedures for performing Meta-Analyses of the accuracy of tools for binary classification. The assessment of accuracy in binary classification tools must take into account two non-independent rates: true positives and false positives. A variety of indices have been proposed. They have been estimated for tests employed for early detection or screening purposes. We summarize and review the main methods proposed for performing a meta-analysis that assesses the accuracy of this type of tools. They are applied to the results from 14 studies that report estimates of the accuracy of the AUDIT. The method of direct aggregation does not allow the use of meta-analytic procedures; the separate estimation of sensitivity and specificity does not acknowledge that they are not independent; the SROC method treats accuracy and threshold as fixed effects and has limitations to deal with the potential role of covariates. The Normal Bivariate (NB) model and the Hierarchical Summary ROC (HSROC) model are statistically rigorous and can deal with the covariates properly. They allowed analyzing the association between the gender composition of the sample and the way the test AUDIT behaves in the example.

PDF

Impact Factor JCR SSCI Clarivate 2023 = 3.2 (Q1) / CiteScore SCOPUS 2023 = 6.5 (Q1)