Psicothema was founded in Asturias (northern Spain) in 1989, and is published jointly by the Psychology Faculty of the University of Oviedo and the Psychological Association of the Principality of Asturias (Colegio Oficial de Psicología del Principado de Asturias).
We currently publish four issues per year, which accounts for some 100 articles annually. We admit work from both the basic and applied research fields, and from all areas of Psychology, all manuscripts being anonymously reviewed prior to publication.
Susana Sanduvete-Chaves1, Daniel López-Arenas1, M. Teresa Anguera2 and Salvador Chacón-Moscoso1,3
Background: To date, no studies have shown validity evidence of a scale that measures the methodological quality of studies based on observational methodology (SBOM). This study presents validity evidence of the Methodological Quality Scale for Studies based on Observational Methodology (MQSOM) based on its internal structure. Method: MQSOM was applied to 650 journal articles that used observational methodology. The Intraclass Correlation Coefficient (ICC) was calculated to obtain evidence of inter- and intracoder reliability. Parallel analysis was done using optimal implementation to study the dimensionality of the scale before conducting an exploratory factor analysis with a randomly-selected half of the sample, followed by a confirmatory factor analysis with the remaining half. Results: Both inter- and intra-coder reliability were adequate, ICC > .73. Parallel analysis suggested a lack of unidimensionality, UniCo = .41; ECV = .31. A second-order factor structure (general factor: Methodological quality) with two first-order factors (F1 Design, F2 Measurement and Analysis) was obtained, RMSEA = 0.000, NNFI = 1, GFI = .98, AGFI = .97, with adequate reliability and discrimination results. Conclusions: MQSOM is a short (11 items), useful instrument for professionals, researchers or assessment commissions when designing, implementing, or evaluating SBOM.
Antecedentes: Hasta donde conocemos, hay escasa evidencia de validez de escalas para medir calidad metodológica de estudios basados en metodología observacional (EBMO). Se presentan evidencias de validez de la Escala de Calidad Metodológica (MQSOM) para EBMO en base a su estructura interna. Método: Se aplicó MQSOM a 650 artículos que emplearon metodología observacional. Se calculó el coeficiente de correlación intraclase (CCI) para la fiabilidad inter e intracodificadores. Se realizó un análisis paralelo mediante implementación óptima para estudiar su dimensionalidad. Finalmente, se realizó un análisis factorial exploratorio con media muestra obtenida aleatoriamente, seguido de un análisis factorial confirmatorio con la otra mitad. Resultados: La fiabilidad inter e intra codificador fueron adecuadas (CCI > ,73). El análisis paralelo sugirió multidimensionalidad (UniCo = .41, ECV = .31). Se obtuvo una estructura factorial de segundo orden (factor general: Calidad metodológica) con dos factores de primer orden (F1 Diseño y F2 Medición y análisis), RMSEA = 0.000, NNFI = 1, GFI = .98, AGFI = .97, con adecuados resultados en fiabilidad y discriminación. Conclusiones: MQSOM es un instrumento breve (11 ítems), útil para profesionales de la intervención, investigadores o comisiones de valoración, para diseñar, implementar o evaluar EBMO.
SPANISH
ENGLISH
https://doi.org/10.70478/psicothema.2025.37.01