Scientific production on the Mantel-Haenszel procedure as a way of detecting DIF

  1. Guilera Ferré, Georgina
  2. Gómez Benito, Juana
  3. Hidalgo Montesinos, María Dolores
Revista:
Psicothema

ISSN: 0214-9915

Año de publicación: 2009

Volumen: 21

Número: 3

Páginas: 492-498

Tipo: Artículo

DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: Psicothema

Resumen

Producción científica sobre el procedimiento Mantel-Haenszel como método de detección del DIF. Tras más de dos décadas de la aplicación del procedimiento Mantel-Haenszel (MH) como técnica de detección del Funcionamiento Diferencial del Ítem (FDI), se realizó un estudio bibliométrico sobre el procedimiento MH para conocer en más profundidad el estado actual de la actividad investigadora en esta área (en términos de indicadores cuantitativos e impacto). Inicialmente, se define un mapa de la productividad científica en el tema de investigación que nos ocupa, y posteriormente se presenta un análisis detallado de las citas que reciben los autores y trabajos dedicados al estudio de MH. Los principales resultados sugieren que el estudio de MH alcanza su cenit en 1995, la revista más productiva es Journal of Educational Measurement, seguida de Applied Psychological Measurement, el país con una mayor productividad es EUA, las instituciones que contribuyen en la investigación son mayoritariamente universidades, los datos se ajustan a la ley de Lotka y no confirman la ley exponencial propuesta por Price, y finalmente se observa una elevada concentración de citas durante los años 90. En este contexto el procedimiento MH sigue siendo utilizado y estudiado, por lo que en un futuro pueden surgir ciertos desarrollos y aplicaciones, suponiendo nuevas publicaciones teóricas, empíricas y de simulación.

Referencias bibliográficas

  • Allen, N.L., & Donoghue, J.R. (1996). Applying the Mantel-Haenszel procedure to complex samples of items. Journal of Educational Measurement, 33(2), 231-251.
  • Ball, R., & Tunger, D. (2006). Bibliometric analysis a new business area for information professionals in libraries? Support for scientific research by perception and trend analysis. Scientometrics, 66(3), 561-577.
  • Beaver, D.D. (2001). Reflections on scientific collaboration (and its study): Past, present, and future. Scientometrics, 52(3), 365-377.
  • Bolt, D.M., & Gierl, M.J. (2006). Testing features of graphical DIF: Application of a regression correction to three nonparametric statistical tests. Journal of Educational Measurement, 43(4), 313-333.
  • Borgman, C.L., & Furner, J. (2002). Scholarly communication and bibliometrics. Annual Review of Information and Technology, 36(1), 2-72.
  • Bradford, S.C. (1934). Sources of information on specific subjects. Engineering, 23(3), 85-88.
  • Camilli, G., & Shepard, L. (1994). Methods for identifying biased test items. Thousand Oaks, CA: Sage Publications.
  • Chen, C. (2005). CiteSpace: quick guide 1.2. http://cluster.cis.drexel.edu/~cchen/citespace/
  • Donoghue, J.R., & Allen, N.L. (1993). Thin versus thick matching in the Mantel-Haenszel procedure for detecting DIF. Journal of Educational Statistics, 18(2), 131-154.
  • Donoghue, J.R., Holland, P.W., & Thayer, D.T. (1993). A Monte Carlo study of factors that affect the Mantel-Haenszel and standardization measures of differential item functioning. In W.P. Holland & H. Wainer (Eds.): Differential item functioning (pp. 137-166). Hillsdale, NJ: LEA.
  • Dorans, N.J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23(4), 355-368.
  • Dorans, N.J., & Kulick, E. (2006). Differential item functioning on the Mini-Mental State Examination: An application of the MantelHaenszel and standardization procedures. Medical Care, 44(11, Suppl. 3), S107-S114.
  • Elosua, P., & López-Jáuregui, A. (2007). Application of four procedures for detecting differential item functioning in polytomous items [Aplicación de cuatro procedimientos de detección del funcionamiento diferencial sobre ítems politómicos]. Psicothema, 19(2), 329-336.
  • Endersby, J.W. (1996). Collaborative research in the social sciences: Multiple authorship and publication credit. Social Science Quarterly, 77(2), 375-392.
  • Ferreres Traver, D., Fidalgo Aliste, A.M., & Muñiz, J. (2000). Detection of non-uniform DIF: Mantel-Haenszel and logistic regression methods [Detección del funcionamiento diferencial de los ítems no uniforme: comparación de los métodos Mantel-Haenszel y regresión logística]. Psicothema, 12(Suppl. 2), 220-225.
  • Fidalgo, A.M. (1994). MHDIF: A computer program for detecting uniform and nonuniform differential item functioning with the Mantel-Haenszel procedure. Applied Psychological Measurement, 18(3), 300-300.
  • Fidalgo, A.M., Ferreres, D., & Muñiz, J. (2004). Utility of the MantelHaenszel procedure for detecting differential item functioning in small samples. Educational and Psychological Measurement, 64(6), 925-936.
  • Fidalgo, A.M., Hashimoto, K., Bartram, D., & Muñiz, J. (2007). Empirical Bayes versus standard Mantel-Haenszel statistics for detecting differential item functioning under small sample conditions. Journal of Experimental Education, 75(4), 293-314.
  • Fidalgo, A.M., Mellenbergh, G., & Muñiz, J. (1998). Comparison of the Mantel-Haenszel procedure versus the loglinear models for detecting differential item functioning [Comparación del procedimiento MantelHaenszel frente a los modelos loglineales en la detección del funcionamiento diferencial de los ítems]. Psicothema, 10(1), 209-218.
  • Gómez, J., Hidalgo, M.D., Guilera, G., & Moreno, M. (2005). A bibliometric study of differential item functioning. Scientometrics, 64(1), 3-16.
  • Guilera, G., Gómez, J., & Hidalgo, M.D. (2006). Differential item functioning: A bibliometric analysis of journals published in Spanish [Funcionamiento diferencial de los ítems: un análisis bibliométrico de las revistas editadas en español]. Psicothema, 18(4), 841-847.
  • Holland, P.W., & Thayer, D.T. (1988). Differential item performance and Mantel-Haenszel procedure. In H. Wainer & H.I. Braun (Eds.): Test validity (pp. 129-145). Hillsdale, NJ: Erlbaum.
  • Kim, S.H., Cohen, A.S., Alagoz, C., & Kim, S. (2007). DIF detection and effect size measures for polytomously scored items. Journal of Educational Measurement, 44(2), 93-116.
  • Mantel, N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719-748.
  • Mazor, K.M, Clauser, B.E., & Hambleton, R.K. (1992). The effect of sample size on the functioning of the Mantel-Haenszel statistic. Educational and Psychological Measurement, 52, 443-451.
  • Mazor, K.M, Clauser, B.E., & Hambleton, R.K. (1994). Identification of nonuniform differential item functioning using a variation of the Mantel-Haenszel procedure. Educational and Psychological Measurement, 54(2), 284-291.
  • Lotka, A.J. (1926). The frequency distribution of scientific productivity. Journal of the Washington Academy of Sciences, 16(12), 317-323.
  • Narayanan, P., & Swaminathan, H. (1994). Performance of the MantelHaenszel and simultaneous item bias procedures for detecting differential item functioning. Applied Psychological Measurement, 18(4), 315328.
  • Narayanan, P., & Swaminathan, H. (1996). Identification of items that show nonuniform DIF. Applied Psychological Measurement, 20(3), 257-274.
  • Ockey, G.J. (2007). Investigating the validity of math word problems for English language learners with DIF. Language Assessment Quarterly, 4(2), 149-164.
  • Penfield, R.D. (2005). DIFAS: Differential Item Functioning Analysis System. Applied Psychological Measurement, 29(2), 150-151.
  • Penfield, R.D. (2007). Assessing differential step functioning in polytomous items using a common odds ratio estimator. Journal of Educational Measurement, 44(3), 187-210.
  • Ponsoda, V., Abad, F.J., Francis, L.J., & Hills, P.R. (2008). Gender differences in the Coopersmith Self-Esteem Inventory: The incidence of differential item functioning. Journal of Individual Differences, 29(4), 217-222.
  • Price, D.J.S. (1963). Little science, big science. New York: Columbia University Press.
  • Raju, N.S. (1988). The area between two item characteristics curves. Psychometrika, 53(4), 495-502.
  • Roever, C. (2007). DIF in the assessment of second language pragmatics. Language Assessment Quarterly, 4(2), 165-189.
  • Rogers, H.J., & Swaminathan, H. (1993). A comparison of logistic regression and Mantel-Haenszel procedures for detecting differential item functioning. Applied Psychological Measurement, 17(2), 105-116.
  • Ross, S.J., & Okabe, J. (2006). The subjective and objective interface of bias detection on language tests. International Journal of Testing, 6(3), 229-253.
  • Shealy, R., & Stout, W. (1993). A model-based standardization approach that separates tru bias/DIF from group ability differences and detects test bias/DTF as well as item bias/DIF. Psychometrika, 58(2), 159-194.
  • Sinharay, S. (2006). Model diagnostics for Bayesian networks. Journal of Educational and Behavioral Statistics, 31(1), 1-33.
  • Swaminathan, H., & Rogers, H.J. (1990). Detecting differential item functioning using logistic regression procedures. Journal of Educational Measurement, 27(4), 361-370.
  • Uttaro, T., & Millsap, R.E. (1994). Factors influencing the MantelHaenszel procedure in the detection of differential item functioning. Applied Psychological Measurement, 18(1), 15-25.
  • Waller, N.G. (1998). EZDIF: Detection of uniform and nonuniform differential item functioning with the Mantel-Haenszel and logistic regression procedures. Applied Psychological Measurement, 22(4), 391-391.
  • Wang, W.C., & Su, Y.H. (2004). Factors influencing the Mantel and the Generalized Mantel-Haenszel methods for the assessment of differential item functioning in polytomous items. Applied Psychological Measurement, 28(6), 450-480.
  • Williams, N.J. (2006). DIF identification using HGLM for polytomous items. Applied Psychological Measurement, 30(1), 22-42.
  • Zwick, R. (1990). When do item response function and Mantel-Haenszel definitions of differential item functioning coincide? Journal of Educational Statistics, 15(3), 185-197.
Fuente de los datos: Dialnet