Computational Psychometrics: New Methodologies for a New Generation of Digital Learning and Assessment

This book defines and describes a new discipline, named computational psychometrics, from the perspective of new methodologies for handling complex data from digital learning and assessment. The editors and the contributing authors discuss how new technology drastically increases the possibilities for the design and administration of learning and assessment systems, and how doing so significantly increases the variety, velocity, and volume of the resulting data. Then they introduce methods and strategies to address the new challenges, ranging from evidence identification and data modeling to the assessment and prediction of learners' performance in complex settings, as in collaborative tasks, game/simulation-based tasks, and multimodal learning and assessment tasks.

Computational psychometrics has thus been defined as a blend of theory-based psychometrics and data-driven approaches from machine learning, artificial intelligence, and data science. All these together provide a better methodological framework for analysing complex data from digital learning and assessments. The term computational has been widely adopted by many other areas, as with computational statistics, computational linguistics, and computational economics. In those contexts, computational has a meaning similar to the one proposed in this book: a data-driven and algorithm-focused perspective on foundations and theoretical approaches established previously, now extended and, when necessary, reconceived. This interdisciplinarity is already a proven success in many disciplines, from personalized medicine that uses computational statistics to personalized learning that uses, well, computational psychometrics. We expect that this volume will be of interest not just within but beyond the psychometric community. In this volume, experts in psychometrics, machine learning, artificial intelligence, data science and natural language processing illustrate their work, showing how the interdisciplinary expertise of each researcher blends into a coherent methodological framework to deal with complex data from complex virtual interfaces. In the chapters focusing on methodologies, the authors use real data examples to demonstrate how to implement the new methods in practice. The corresponding programming codes in R and Python have been included as snippets in the book and are also available in fuller form in the GitHub code repository that accompanies the book.

Presents a new discipline specific to educational assessment and crystalizes the integration of several methodologies in a unique way Extends hard-won psychometric insights to a larger universe of constructs, data types, and technological environments Provides the substantive context for harnessing the power of advanced data analytic methods to the particular problems of assessment Facilitates the development of new tests and applications by providing code for R and Python

Autorentext

Klappentext

This book defines and describes a new discipline, named computational psychometrics, from the perspective of new methodologies for handling complex data from digital learning and assessment. The editors and the contributing authors discuss how new technology drastically increases the possibilities for the design and administration of learning and assessment systems, and how doing so significantly increases the variety, velocity, and volume of the resulting data. Then they introduce methods and strategies to address the new challenges, ranging from evidence identification and data modeling to the assessment and prediction of learners performance in complex settings, as in collaborative tasks, game/simulation-based tasks, and multimodal learning and assessment tasks. Computational psychometrics has thus been defined as a blend of theory-based psychometrics and data-driven approaches from machine learning, artificial intelligence, and data science. All these together provide a better methodological framework for analysing complex data from digital learning and assessments. The term computational has been widely adopted by many other areas, as with computational statistics, computational linguistics, and computational economics. In those contexts, computational has a meaning similar to the one proposed in this book: a data-driven and algorithm-focused perspective on foundations and theoretical approaches established previously, now extended and, when necessary, reconceived. This interdisciplinarity is already a proven success in many disciplines, from personalized medicine that uses computational statistics to personalized learning that uses, well, computational psychometrics. We expect that this volume will be of interest not just within but beyond the psychometric community. In this volume, experts in psychometrics, machine learning, artificial intelligence, data science and natural language processing illustrate their work, showing how the interdisciplinary expertise of each researcher blends into a coherent methodological framework to deal with complex data from complex virtual interfaces. In the chapters focusing on methodologies, the authors use real data examples to demonstrate how to implement the new methods in practice. The corresponding programming codes in R and Python have been included as snippets in the book and are also available in fuller form in the GitHub code repository that accompanies the book.

Inhalt

1. Introduction. Computational Psychometrics: Towards a Principled Integration of Data Science and Machine Learning Techniques into Psychometrics (Alina A. von Davier, Robert Mislevy and Jiangang Hao).- Part I. Conceptualization. 2. Next generation learning and assessment: what, why and how (Robert Mislevy).- 3. Computational psychometrics (Alina A. von Davier, Kristen DiCerbo and Josine Verhagen).- 4. Virtual performance-based assessments (Jessica Andrews-Todd, Robert Mislevy, Michelle LaMar and Sebastiaan de Klerk).- 5. Knowledge Inference Models Used in Adaptive Learning (Maria Ofelia Z. San Pedro and Ryan S. Baker).- Part II. Methodology. 6. Concepts and models from Psychometrics (Robert Mislevy and Maria Bolsinova).- 7. Bayesian Inference in Large-Scale Computational Psychometrics (Gunter Maris, Timo Bechger and Maarten Marsman).- 8. Data science perspectives (Jiangang Hao and Robert Mislevy).- 9. Supervised machine learning (Jiangang Hao).- 10. Unsupervised machine learning (Pak Chunk Wong).- 11. AI and deep learning for educational research (Yuchi Huang and Saad M. Khan).- 12. Time series and stochastic processes (Peter Halpin, Lu Ou and Michelle LaMar).- 13. Social network analysis (Mengxiao Zhu).- 14. Text mining and automated scoring (Michael Flor and Jiangang Hao).