Skip to main content
Erschienen in: Journal of Pediatric Neuropsychology 1/2022

01.03.2022 | Review

Overview of Modern Measurement Theory and Examples of Its Use to Measure Execution Function in Children

verfasst von: Carrie R. Houts, Andrea Savord, R. J. Wirth

Erschienen in: Journal of Pediatric Neuropsychology | Ausgabe 1/2022

Einloggen, um Zugang zu erhalten

Abstract

Researchers and clinicians in neuropsychology are interested in measuring constructs that cannot be directly observed, such as cognitive ability, executive function, or depression. Modern measurement theory (MMT) provides a framework for understanding and measuring these constructs (also called latent variables) through the use of test batteries and other assessments that provide observable responses that are theoretically related to the underlying construct of interest. MMT subsumes a number of statistical methods, including factor analysis and item response theory (IRT), that are focused on using observable responses to model these unobservable constructs. These methods are able to provide information on how test batteries or individual items relate to each other and the latent variable across varying levels of the construct of interest (e.g., mild ADHD and severe ADHD). Finally, we review several applications of IRT to the measurement of executive function in children to highlight the unique information IRT provides when evaluating the relationship of observed responses to unobservable constructs. In summary, this paper seeks to provide an accessible overview of latent variable models within MMT (with a focus on IRT) that could improve measurement in neuropsychology, if more widely used, and offer readers the foundations of a knowledge base to become more critical consumers of measurement-related research in pediatric neuropsychology.
Literatur
Zurück zum Zitat Byrne, B. M. (2005). Factor analytic models: Viewing the structure of an assessment instrument from three perspectives. Journal of personality assessment, 85(1), 17–32.CrossRefPubMed Byrne, B. M. (2005). Factor analytic models: Viewing the structure of an assessment instrument from three perspectives. Journal of personality assessment, 85(1), 17–32.CrossRefPubMed
Zurück zum Zitat Cai, L., & Houts, C. R. (2021). Longitudinal analysis of patient reported outcomes in clinical trials: Applications of multilevel and multidimensional item response theory. Psychometrika, 86(3), 754–777.CrossRef Cai, L., & Houts, C. R. (2021). Longitudinal analysis of patient reported outcomes in clinical trials: Applications of multilevel and multidimensional item response theory. Psychometrika, 86(3), 754–777.CrossRef
Zurück zum Zitat Cronbach, L. J. (1947). Test “reliability”: Its meaning and determination. Psychometrika, 12(1), 1–16.CrossRefPubMed Cronbach, L. J. (1947). Test “reliability”: Its meaning and determination. Psychometrika, 12(1), 1–16.CrossRefPubMed
Zurück zum Zitat De Champlain, A. F. (2010). A primer on classical test theory and item response theory for assessments in medical education. Medical Education, 44, 109–117.CrossRef De Champlain, A. F. (2010). A primer on classical test theory and item response theory for assessments in medical education. Medical Education, 44, 109–117.CrossRef
Zurück zum Zitat Edwards, M. C. (2009). An introduction to item response theory using the need for cognition scale. Social and Personality Psychology Compass, 3(4), 507–529.CrossRef Edwards, M. C. (2009). An introduction to item response theory using the need for cognition scale. Social and Personality Psychology Compass, 3(4), 507–529.CrossRef
Zurück zum Zitat Edwards, M. C., & Houts, C. R. (2017). Conceptual overview of computerized adaptive testing. Value and Outcomes Spotlight, 3, 11–12. Edwards, M. C., & Houts, C. R. (2017). Conceptual overview of computerized adaptive testing. Value and Outcomes Spotlight, 3, 11–12.
Zurück zum Zitat Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8(4), 341–349.CrossRef Embretson, S. E. (1996). The new rules of measurement. Psychological Assessment, 8(4), 341–349.CrossRef
Zurück zum Zitat Gibbons, R. D., & Hedeker, D. (1992). Full-information item bifactor analysis. Psychometrika, 57, 423–436.CrossRef Gibbons, R. D., & Hedeker, D. (1992). Full-information item bifactor analysis. Psychometrika, 57, 423–436.CrossRef
Zurück zum Zitat Howard, M. C. (2016). A review of exploratory factor analysis decision and overview of current practices: What are we doing and how can we improve? International Journal of Human-Computer Interaction, 32(1), 51–62.CrossRef Howard, M. C. (2016). A review of exploratory factor analysis decision and overview of current practices: What are we doing and how can we improve? International Journal of Human-Computer Interaction, 32(1), 51–62.CrossRef
Zurück zum Zitat Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological bulletin, 144(11), 1147. Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological bulletin, 144(11), 1147.
Zurück zum Zitat Langer, M. M., Hill, C. D., Thissen, D., Burwinkle, T. M., Varni, J. W., & DeWalt, D. A. (2008). Item response theory detected differential functioning between healthy and ill children in quality of life metrics. Journal of Clinical Epidemiology, 61(3), 268–276.CrossRef Langer, M. M., Hill, C. D., Thissen, D., Burwinkle, T. M., Varni, J. W., & DeWalt, D. A. (2008). Item response theory detected differential functioning between healthy and ill children in quality of life metrics. Journal of Clinical Epidemiology, 61(3), 268–276.CrossRef
Zurück zum Zitat Lecavalier, L., Gadow, K. D., Devincent, C. J., Houts, C. R., & Edwards, M. C. (2011). Validity of DSM-IV syndromes in preschoolers with autism spectrum disorders. Autism, 15(5), 527–543.CrossRef Lecavalier, L., Gadow, K. D., Devincent, C. J., Houts, C. R., & Edwards, M. C. (2011). Validity of DSM-IV syndromes in preschoolers with autism spectrum disorders. Autism, 15(5), 527–543.CrossRef
Zurück zum Zitat MacCallum, R. C. (2007). Factor analysis. In R. E. Millsap & A. Maydeu-Olivares (Eds.), The Sage Handbook of Quantitative Methods in Psychology (pp. 123–147). Sage. MacCallum, R. C. (2007). Factor analysis. In R. E. Millsap & A. Maydeu-Olivares (Eds.), The Sage Handbook of Quantitative Methods in Psychology (pp. 123–147). Sage.
Zurück zum Zitat Naglieri, J. A., Goldstein, S. (2014) Using the Comprehensive Executive Function Inventory (CEFI) to assess executive function: From theory to application. In: Goldstein S., Naglieri J. (eds) Handbook of Executive Functioning. Springer, New York, NY. https://doi.org/10.1007/978-1-4614-8106-5_14 Naglieri, J. A., Goldstein, S. (2014) Using the Comprehensive Executive Function Inventory (CEFI) to assess executive function: From theory to application. In: Goldstein S., Naglieri J. (eds) Handbook of Executive Functioning. Springer, New York, NY. https://​doi.​org/​10.​1007/​978-1-4614-8106-5_​14
Zurück zum Zitat Nunnally, J. C. (1978). Psychometric Theory (2nd ed.). McGraw-Hill. Nunnally, J. C. (1978). Psychometric Theory (2nd ed.). McGraw-Hill.
Zurück zum Zitat Ryan, R. M., Fauth, R. C., & Brooks-Gunn, J. (2006). Childhood Poverty: Implications for School Readiness and Early Childhood Education. In B. Spodek & O. N. Saracho (Eds.), Handbook of research on the education of young children (pp. 323–346). Lawrence Erlbaum Associates Publishers. Ryan, R. M., Fauth, R. C., & Brooks-Gunn, J. (2006). Childhood Poverty: Implications for School Readiness and Early Childhood Education. In B. Spodek & O. N. Saracho (Eds.), Handbook of research on the education of young children (pp. 323–346). Lawrence Erlbaum Associates Publishers.
Zurück zum Zitat Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph Supplement, 34(4, Pt. 2), 100. Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph Supplement, 34(4, Pt. 2), 100.
Zurück zum Zitat Teresi, J. A., Ocepek-Welikson, K., Kleinman, M., Ramirez, M., & Kim, G. (2016). Psychometric properties and performance of the patient reported outcomes measurement information system ® (PROMIS®) depression short forms in ethnically diverse groups. Psychological Test and Assessment Modeling, 58(1), 141–181.PubMedPubMedCentral Teresi, J. A., Ocepek-Welikson, K., Kleinman, M., Ramirez, M., & Kim, G. (2016). Psychometric properties and performance of the patient reported outcomes measurement information system ® (PROMIS®) depression short forms in ethnically diverse groups. Psychological Test and Assessment Modeling, 58(1), 141–181.PubMedPubMedCentral
Zurück zum Zitat Thissen, D. & Orlando, M., (2001). Item response theory for items scores in two categories. In D. Thissen & HJ. Wainer (Eds). Test Scoring (pp. 73–140). Mahwah, NJ: Lawrence Erlbaum Associates Thissen, D. & Orlando, M., (2001). Item response theory for items scores in two categories. In D. Thissen & HJ. Wainer (Eds). Test Scoring (pp. 73–140). Mahwah, NJ: Lawrence Erlbaum Associates
Zurück zum Zitat Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential Item Functioning (pp. 67–113). Lawrence Erlbaum Associates, Inc. Thissen, D., Steinberg, L., & Wainer, H. (1993). Detection of differential item functioning using the parameters of item response models. In P. W. Holland & H. Wainer (Eds.), Differential Item Functioning (pp. 67–113). Lawrence Erlbaum Associates, Inc.
Zurück zum Zitat Thurstone, L. L. (1938). Primary mental abilities. Psychometric Monographs, 1, ix + 121. Thurstone, L. L. (1938). Primary mental abilities. Psychometric Monographs, 1, ix + 121.
Zurück zum Zitat Wainer, H., Dorans, N. J., Green, B. F., Steinberg, L., Flaugher, R., Mislevy, R. J., & Thissen, D. (2000). Computerized adaptive testing: A primer (2nd edition). Lawrence Erlbaum Associates, Inc Wainer, H., Dorans, N. J., Green, B. F., Steinberg, L., Flaugher, R., Mislevy, R. J., & Thissen, D. (2000). Computerized adaptive testing: A primer (2nd edition). Lawrence Erlbaum Associates, Inc
Zurück zum Zitat Welsh, J. A., Nix, R. L., Blair, C., Bierman, K. L., & Nelson, K. E. (2010). The development of cognitive skills and gains in academic school readiness for children from low-income families. Journal of Educational Psychology, 102(1), 43–53.CrossRef Welsh, J. A., Nix, R. L., Blair, C., Bierman, K. L., & Nelson, K. E. (2010). The development of cognitive skills and gains in academic school readiness for children from low-income families. Journal of Educational Psychology, 102(1), 43–53.CrossRef
Zurück zum Zitat Widaman, K. F. (2012). Exploratory factor analysis and confirmatory factor analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 3. Data analysis and research publication (pp. 361–389). American Psychological Association. https://doi.org/10.1037/13621-018 Widaman, K. F. (2012). Exploratory factor analysis and confirmatory factor analysis. In H. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 3. Data analysis and research publication (pp. 361–389). American Psychological Association. https://​doi.​org/​10.​1037/​13621-018
Zurück zum Zitat Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2010). The measurement of executive function at age 3 years: Psychometric properties and criterion validity of a new battery of tasks. Psychological Assessment, 22(2), 306–317.CrossRef Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2010). The measurement of executive function at age 3 years: Psychometric properties and criterion validity of a new battery of tasks. Psychological Assessment, 22(2), 306–317.CrossRef
Zurück zum Zitat Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2012). The measurement of executive function at age 5: Psychometric properties and relationship to academic achievement. Psychological Assessment, 24(1), 226–239.CrossRef Willoughby, M. T., Blair, C. B., Wirth, R. J., Greenberg, M., & The Family Life Project Investigators. (2012). The measurement of executive function at age 5: Psychometric properties and relationship to academic achievement. Psychological Assessment, 24(1), 226–239.CrossRef
Zurück zum Zitat Willoughby, M. T., Wirth, R. J., & Blair, C. B. (2011). Contributions of modern measurement theory to measuring executive function in early childhood: An empirical demonstration. Journal of Experimental Child Psychology, 108, 414–435.CrossRef Willoughby, M. T., Wirth, R. J., & Blair, C. B. (2011). Contributions of modern measurement theory to measuring executive function in early childhood: An empirical demonstration. Journal of Experimental Child Psychology, 108, 414–435.CrossRef
Zurück zum Zitat Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Measurement, 67, 73–87. Wirth, R. J., & Edwards, M. C. (2007). Item factor analysis: Current approaches and future directions. Psychological Measurement, 67, 73–87.
Metadaten
Titel
Overview of Modern Measurement Theory and Examples of Its Use to Measure Execution Function in Children
verfasst von
Carrie R. Houts
Andrea Savord
R. J. Wirth
Publikationsdatum
01.03.2022
Verlag
Springer International Publishing
Erschienen in
Journal of Pediatric Neuropsychology / Ausgabe 1/2022
Print ISSN: 2199-2681
Elektronische ISSN: 2199-2673
DOI
https://doi.org/10.1007/s40817-021-00117-7

Weitere Artikel der Ausgabe 1/2022

Journal of Pediatric Neuropsychology 1/2022 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Nicht Creutzfeldt Jakob, sondern Abführtee-Vergiftung

29.05.2024 Hyponatriämie Nachrichten

Eine ältere Frau trinkt regelmäßig Sennesblättertee gegen ihre Verstopfung. Der scheint plötzlich gut zu wirken. Auf Durchfall und Erbrechen folgt allerdings eine Hyponatriämie. Nach deren Korrektur kommt es plötzlich zu progredienten Kognitions- und Verhaltensstörungen.

Schutz der Synapsen bei Alzheimer

29.05.2024 Morbus Alzheimer Nachrichten

Mit einem Neurotrophin-Rezeptor-Modulator lässt sich möglicherweise eine bestehende Alzheimerdemenz etwas abschwächen: Erste Phase-2-Daten deuten auf einen verbesserten Synapsenschutz.

Sozialer Aufstieg verringert Demenzgefahr

24.05.2024 Demenz Nachrichten

Ein hohes soziales Niveau ist mit die beste Versicherung gegen eine Demenz. Noch geringer ist das Demenzrisiko für Menschen, die sozial aufsteigen: Sie gewinnen fast zwei demenzfreie Lebensjahre. Umgekehrt steigt die Demenzgefahr beim sozialen Abstieg.

Hirnblutung unter DOAK und VKA ähnlich bedrohlich

17.05.2024 Direkte orale Antikoagulanzien Nachrichten

Kommt es zu einer nichttraumatischen Hirnblutung, spielt es keine große Rolle, ob die Betroffenen zuvor direkt wirksame orale Antikoagulanzien oder Marcumar bekommen haben: Die Prognose ist ähnlich schlecht.

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.