A reliability generalization meta-analysis of the Padua Inventory-Revised (PI-R)

  1. Rosa María Núñez-Núñez 1
  2. María Rubio-Aparicio 2
  3. Fulgencio Marín-Martínez 3
  4. Julio Sánchez-Meca 3
  5. José Antonio López-Pina 3
  6. José Antonio López-López 3
  1. 1 Universidad Miguel Hernández de Elche
    info

    Universidad Miguel Hernández de Elche

    Elche, España

    ROR https://ror.org/01azzms13

  2. 2 Universitat d'Alacant
    info

    Universitat d'Alacant

    Alicante, España

    ROR https://ror.org/05t8bcz72

  3. 3 Universidad de Murcia
    info

    Universidad de Murcia

    Murcia, España

    ROR https://ror.org/03p3aeb86

Revista:
International journal of clinical and health psychology

ISSN: 1697-2600

Año de publicación: 2022

Volumen: 22

Número: 1

Páginas: 61-70

Tipo: Artículo

DOI: 10.1016/J.IJCHP.2021.100277 DIALNET GOOGLE SCHOLAR lock_openAcceso abierto editor

Otras publicaciones en: International journal of clinical and health psychology

Resumen

Background/Objective: The Padua Inventory-Revised (PI-R) is a widely applied instrument to measure obsessive-compulsive symptoms in clinical and nonclinical samples. We conducted a reliability generalization meta-analysis on the PI-R. Method: An exhaustive literature search yielded 118 empirical studies that had applied the PI-R, from which 30 studies (33 samples) reported an original reliability estimate. Results: Assuming a random-effects model, the average internal consistency reliability (Cronbach's alpha) was .92 (95% CI [.91, .93]) for the total scores, and ranged from .74 to .89 for the subscales. Assuming mixed-effects models, moderator analyses showed a positive statistically significant association between the standard deviation of the total scores and the reliability coefficients (p = .002; R2 = .38). Conclusions: In terms of reliability, the PI-R scale was found to be adequate for both research and clinical purposes, although exhibiting large heterogeneity across studies. Future empirical studies using the PI-R should be required to provide at least one reliability estimate based on their own data.

Información de financiación

Referencias bibliográficas

  • Abramovitch, A., McCormack, B., Brunner, D., Johnson, M., & Wofford, N. (2019). The impact of symptom severity on cognitive function in obsessive-compulsive disorder: A meta-analysis. Clinical Psychology Review, 67, 36 –44. https://doi.org/10.1016/j.cpr.2018.09.003.
  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders, DSM-5 (5th ed.). American Psychiatric Association.
  • Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M. (2018). Journal article reporting standards for quantitative research in psychology: The APA publications and communications board task force report. AmericanPsychologist, 73, 3 –25. https://doi.org/10.1037/amp0000191.
  • Baruah, U., Pandian, R. D., Narayanaswamy, J. C., Math, S. B., Kandavel, T., & Reddy, Y. J. (2018). A randomized controlled study of brief family-based intervention in obsessive compulsive disorder. Journal of Affective Disorders, 225, 137–146. https://doi.org/10.1016/j.jad.2017.08.014.
  • Be ̧siroglu, L., Agargun, M. Y., Boysan, M., Eryonucu, B., Gule ̧c, M., & Selvi, Y. (2005). The assessment of obsessive-compulsive symptoms: Reliability and validity of the Padua Inventory in a Turkish population. Turkish Journal of Psychiatry, 16, 179–189.
  • Bonett, D. G. (2002). Sample size requirements for testing and estimating coefficient alpha. Journal of Educational and Behavioural Statistics, 27, 335–340. https://doi.org/10.3102/10769986027004335.
  • Brakoulias, V., Perkes, I. E., & Tsalamanios, E. (2018). A call for prevention and early intervention in obsessive-compulsive disorder. Early Intervention in Psychiatry, 12, 572–577. https://doi.org/10.1111/eip.12535.
  • Burns, G. L., Keortge, S. G., Formea, G. M., & Sternberger, L. G. (1996). Revision of the Padua Inventory of obsessive compulsive disorder symptoms: Distinctions between worry, obsessions, and compulsions. Behaviour Research and Therapy, 34, 163 –173. https://doi.org/10.1016/0005-7967(95)00035-6.
  • Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. The Journal of General Psychology, 130, 290–304. https://doi.org/10.1080/00221300309601160.
  • Cooper, H., Hedges, L. V., & Valentine, J. C. (2019). The Handbook of Research Synthesis and Meta-analysis. Russell Sage Foundation.
  • De Bruin, G. O., Rassin, E., & Muris, P. (2005). Cognitive self-consciousness and meta-worry and their relations to symptoms of worry and obsessional thoughts. Psychological Reports, 96, 222–224. https://doi.org/10.2466/pr0.96.1.222-224.
  • Duval, S., & Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463. https://doi.org/10.1111/j.0006-341x.2000.00455.x.
  • Gönner, S., Ecker, W., & Leonhart, R. (2010). The Padua Inventory: Do revisions need revision? Assessment, 17, 89 –106. https://doi.org/10.1177/1073191109342189.
  • Gonzalez-Mulé, E., & Aguinis, H. (2017). Advancing theory by assessing boundary conditions with metaregression: A critical review and best-practice recommendations. Journal of Management, 44, 2246–2273. https://doi.org/10.1177/0149206317710723.
  • Hartung, J., & Knapp, G. (2001). On tests of the overall treatment effect in meta-analysis with normally distributed responses. Statistics in Medicine, 20, 1771–1782. https://doi.org/10.1002/sim.791.
  • IntHout, J., Ioannidis, J. P. A., Rovers, M. M., & Goeman, J. (2016). Plea for routinely presenting prediction intervals in meta-analysis. British Medical Journal Open, 6, Article e010247. https://doi.org/10.1136/bmjopen-2015-010247
  • Irwing, P., Booth, T., & Hughes, D. J. (2018). The Wiley Handbook of Psychometric Testing. Wiley.
  • Kiverstein, J., Rietveld, E., Slagter, H. A., & Denys, D. (2019). Obsessive compulsive disorder: A pathology of self-confidence? Trends in Cognitive Sciences, 23, 369–372. https://doi.org/10.1016/j.tics.2019.02.005.
  • Langan, D., Higgins, J. P. T., Jackson, D., Bowden, J., Veroniki, A. A., Kontopantelis, E., Viechtbauer, W., & Simmonds, M. (2019). A comparison of heterogeneity variance estimators in simulated random-effects meta-analyses. Research Synthesis Methods, 10, 83–98. https://doi.org/10.1002/jrsm.1316.
  • López-Pina, J. A., Sánchez-Meca, J., López-López, J. A., Marín-Martínez, F., Nuñez-Nuñez, R. M., Rosa-Alcazar, A. I., Gomez-Conesa, A., & Ferrer-Requena, J. (2015). The Yale-Brown obsessive compulsive scale: A reliability generalization meta-analysis. Assessment, 22, 619–628. https://doi.org/10.1177/1073191114551954.
  • McFarlane, T., MacDonald, D. E., Trottier, K., & Olmsted, M. P. (2015). The effectiveness of an individualized form of day hospital treatment. Eating Disorders, 23, 191–205. https://doi.org/10.1080/10640266.2014.981430.
  • Mohsen, S. A., Deeb, F. A. E., Ramadan, E. S., & Eissa, M. A. E.-R (2021). Assessment of in Obsessive Compulsive Disorder. Journal of Advances in Medicine and Medical Research, 33, 105 –114. https://doi.org/10.9734/jammr/2021/v33i1030915.
  • Osland, S., Arnold, P. D., & Pringsheim, T. (2018). The prevalence of diagnosed obsessive compulsive disorder and associated comorbidities: A population-based Canadian study. Psychiatry Research, 268, 137–142. https://doi.org/10.1016/j.psychres.2018.07.018.
  • Remmerswaal, K. C. P., Batelaan, N. M., Hoogendoorn, A. W., van der Wee, N. J. A., van Oppen, P., & van Balkom, A. J. L. M. (2020). Four-year course of quality of life and obsessivecompulsive disorder. Social Psychiatry and Psychiatric Epidemiology, 55, 989–1000. https://doi.org/10.1007/s00127-019-01779-7.
  • Rosa-Alcazar, A., García-Hernandez, M. D., Parada-Navas, J. L., Olivares-Olivares, P. J., Martínez-Murillo, S., & Rosa-Alcazar, A. I. (2021). Coping strategies in obsessive-compulsive patients during Covid-19 lockdown. International Journal of Clinical and Health Psychology, 21, Article 100223. https://doi.org/10.1016/j.ijchp.2021.100223.
  • Rubio-Aparicio, M., Lopez-Lopez, J. A., Viechtbauer, W., Marín-Martínez, F., Botella, J., & Sanchez-Meca, J. (2020). Testing categorical moderators in mixed-effects meta-analysis in the presence of heteroscedasticity. The Journal of Experimental Education, 88, 288 –310. https://doi.org/10.1080/00220973.2018.1561404.
  • Rubio-Aparicio, M., Nuñez-Nuñez, R. M., Sanchez-Meca, J., Lopez-Pina, J. A., Marín-Martínez, F., & Lopez-Lopez, J. A. (2020). The Padua InventoryWashington State University Revision of obsessions and compulsions: A reliability generalization meta-analysis. Journal of Personality Assessment, 102, 113–123. https://doi.org/10.1080/00223891.2018.1483378.
  • Rubio-Aparicio, M., Sanchez-Meca, J., Lopez-Lopez, J. A., Botella, J., & Marín-Martínez, F. (2017). Analysis of categorical moderators in mixed-effects meta-analysis: Consequences of using pooled versus separate estimates of the residual between-studies variances. British Journal of Mathematical and Statistical Psychology, 70, 439 –456. https://doi.org/10.1111/bmsp.12092.
  • Sanavio, E. (1988). Obsessions and compulsions: The Padua Inventory. Behaviour Research and Therapy, 26, 169–177. https://doi.org/10.1016/0005-7967(88)90116-7.
  • Sanchez-Meca, J., Lopez-Lopez, J. A., & Lopez-Pina, J. A. (2013). Some recommended statistical analytic practices when reliability generalization (RG) studies are conducted. British Journal of Mathematical and Statistical Psychology, 66, 402–425. https://doi.org/10.1111/j.2044-8317.2012.02057.x.
  • Sanchez-Meca, J., Lopez-Pina, J. A., Lopez-Lopez, J. A., Marín-Martínez, F., Rosa-Alcazar, A. I., & Gomez-Conesa, A. (2011). The Maudsley Obsessive-Compulsive Inventory: A reliability generalization meta-analysis. International Journal of Clinical and Health Psychology, 11, 473–493.
  • Sanchez-Meca, J., Marín-Martínez, F., Lopez-Lopez, J. A., Nuñez-Nuñez, R. M., Rubio-Aparicio, M., Lopez-García, J. J., Lopez-Pina, J. A., Blazquez-Rincon, D. M., Lopez-Ibañez, C., & Lopez-Nicolas, R. (2021). Improving the Reporting Quality of Reliability Generalization Meta-analyses: The REGEMA Checklist. Research Synthesis Methods. https://doi.org/10.1002/jrsm.1487.
  • Sanchez-Meca, J., Rubio-Aparicio, M., Nuñez-Nuñez, R. M., Lopez-Pina, J. A., Marín-Martínez, F., & Lopez-Lopez, J. A. (2017). A reliability generalization meta-analysis of the Padua Inventory of obsessions and compulsions. The Spanish Journal of Psychology, 20, Article 70. https://doi.org/10.1017/sjp.2017.65.
  • Shields, A. L., & Caruso, J. C. (2004). A reliability induction and reliability generalization study of the Cage Questionnaire. Educational and Psychological Measurement, 64, 254–270. https://doi.org/10.1177/0013164403261814.
  • Sterne, J. A., Sutton, A. J., Ioannidis, J., Terrin, N., Jones, D. R., Lau, J., Carpenter, J., R€ucker, G., Harbord, R. M., Schmid, C. H., etzlaff, J., Deeks, J. J., Peters, J., Macaskill, P., Scchwarzer, G., Duval, S., Altman, D. G., Moher, D., & Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. British Medical Journal, 343, Article D4002. https://doi.org/10.1136/bmj.d4002.
  • Tipton, E., Pustejovsky, J. E., & Ahmadi, H. (2019). Current practices in meta-regression in psychology, education, and medicine. Research Synthesis Methods, 10, 180–194. https://doi.org/10.1002/jrsm.1339.
  • Vacha-Haase, T. (1998). Reliability generalization: Exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58, 6 –20. https://doi.org/10.1177/0013164498058001002.
  • van Oppen, P., Hoekstra, R. J., & Emmelkamp, P. M. (1995). The structure of obsessive-compulsive symptoms. Behaviour Research and Therapy, 33, 15 –23. https://doi.org/10.1016/0005-7967(94)E0010-G.
  • Vriend, C., de Wit, S. J., Remijnse, P. L., van Balkom, A. J., Veltman, D. J., & van den Heuvel, O. A. (2013). Switch the itch: A naturalistic follow-up study on the neural correlates of cognitive flexibility in obsessive-compulsive disorder. Psychiatry Research: Neuroimaging, 213, 31 –38. https://doi.org/10.1016/ j.pscychresns.2012.12.006.