Statistical Modeling of the National Assessment of Educational Progress

This book details a fully integrated model that incorporates both the survey design and the psychometric model by extending the traditional psychometric model form to accommodate the design structure while allowing for student, teacher, and school covariates.

The purpose of this book is to evaluate a new approach to the analysis and reporting of the large-scale surveys for the National Assessment of Educational Progress carried out for the National Center for Education Statistics. The need for a new approach was driven by the demands for secondary analysis **of the survey data by researchers who needed analyses more detailed than those published by NCES, and the need to accelerate the processing and publication of results from the surveys.

This new approach is based on a full multilevel statistical and psychometric model for students' responses to the test items, taking into account the design of the survey, the backgrounds of the students, and the classes, schools and communities in which the students were located. The authors detail a fully integrated single model that incorporates both the survey design and the psychometric model by extending the traditional form of the psychometric model to accommodate the design structure while allowing for student, teacher, and school covariates.

The models and analysis approach are illustrated with detailed results from two NAEP surveys. The use of a full statistical model avoids the ad hoc methods that are otherwise necessary for the analysis of the data. The modeling approach is complex and computationally intensive, but less so than the existing methods used for these surveys, and it has the twin advantages of efficiency and optimality. Includes supplementary material: sn.pub/extras

Inhalt

Theories of Data Analysis and Statistical Inference.- The Current Design and Analysis.- Psychometric and Survey Models.- Technical Reports Data Analyses and Simulation Studies.- 1986 NAEP Math Survey.- Analysis of All 1986Math Iems.- 2005 NAEP Math Survey Texas.- 2005 NAEP Math Survey California.- Conclusions.- 1986 Survey Results, 30 Item Subscale.- 1986 Survey Results, Full 79 Items.- Model Parameter Estimates and SEs, 2005 Texas Survey.- Model Parameter Estimates and SEs, 2005 California survey.